May 26 04:55:13.586726 np0000001388 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service.
May 26 04:55:15.306024 np0000001388 nova-compute[98319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=98319) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 26 04:55:15.306923 np0000001388 nova-compute[98319]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=98319) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}}
May 26 04:55:15.306923 np0000001388 nova-compute[98319]: INFO os_vif [-] Loaded VIF plugins: noop, ovs
May 26 04:55:15.444009 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:55:15.454029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.010s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:55:15.617534 np0000001388 nova-compute[98319]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative
May 26 04:55:16.391615 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks.
May 26 04:55:16.392157 np0000001388 nova-compute[98319]: INFO nova.utils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] The long task thread pool MainProcess.long_task is initialized
May 26 04:55:16.392157 np0000001388 nova-compute[98319]: INFO nova.virt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Loading compute driver 'libvirt.LibvirtDriver'
May 26 04:55:16.480140 np0000001388 nova-compute[98319]: INFO nova.compute.provider_config [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
May 26 04:55:16.982371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Acquiring lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:55:16.982488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Acquired lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:55:16.982951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Releasing lock "singleton_lock" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:55:16.982951 np0000001388 nova-compute[98319]: WARNING oslo_service.backend._threading.service [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] no_fork=True: running service in main process
May 26 04:55:16.983228 np0000001388 nova-compute[98319]: INFO nova.service [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Starting compute node (version 33.1.0)
May 26 04:55:17.486621 np0000001388 nova-compute[98319]: INFO nova.utils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] The default thread pool MainProcess.default is initialized
May 26 04:55:17.487358 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:55:17.487697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Starting event thread {{(pid=98319) start /opt/stack/nova/nova/virt/libvirt/host.py:252}}
May 26 04:55:17.488151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Starting connection event dispatch thread {{(pid=98319) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:553}}
May 26 04:55:17.489052 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Connecting to libvirt: qemu:///system {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:558}}
May 26 04:55:18.195936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0> {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:564}}
May 26 04:55:18.196465 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0> {{(pid=98319) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:585}}
May 26 04:55:18.197393 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Connection event '1' reason 'None'
May 26 04:55:18.700598 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Cannot update service status on host "np0000001388" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001388 could not be found.
May 26 04:55:18.700962 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.mount [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Initialising _HostMountState generation 0 {{(pid=98319) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
May 26 04:55:28.835671 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host capabilities <capabilities>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:   <host>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     <uuid>afb55d94-db41-4ee0-872f-670786e9b79f</uuid>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     <cpu>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <arch>x86_64</arch>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <model>EPYC-Milan</model>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <microcode version='16777317'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <signature family='25' model='1' stepping='1'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <topology sockets='12' dies='1' cores='1' threads='1'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <maxphysaddr mode='emulate' bits='40'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='x2apic'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='tsc-deadline'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='osxsave'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='hypervisor'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='tsc_adjust'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='ospke'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='vaes'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='vpclmulqdq'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='spec-ctrl'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='stibp'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='arch-capabilities'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='ssbd'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='cmp_legacy'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='topoext'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='stibp-always-on'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='virt-ssbd'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='amd-psfd'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='lbrv'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='tsc-scale'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='vmcb-clean'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='flushbyasid'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='pause-filter'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='pfthreshold'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='v-vmsave-vmload'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='vgif'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='no-nested-data-bp'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='lfence-always-serializing'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='null-sel-clr-base'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='rdctl-no'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='skip-l1dfl-vmentry'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='mds-no'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='pschange-mc-no'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <feature name='gds-no'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <pages unit='KiB' size='4'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <pages unit='KiB' size='2048'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <pages unit='KiB' size='1048576'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     </cpu>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     <power_management/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     <iommu support='no'/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     <migration_features>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <live/>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       <uri_transports>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:         <uri_transport>tcp</uri_transport>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:         <uri_transport>rdma</uri_transport>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:       </uri_transports>
May 26 04:55:28.835671 np0000001388 nova-compute[98319]:     </migration_features>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:     <topology>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <cells num='1'>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:         <cell id='0'>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <memory unit='KiB'>24607188</memory>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <pages unit='KiB' size='4'>6151797</pages>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <pages unit='KiB' size='2048'>0</pages>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <pages unit='KiB' size='1048576'>0</pages>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <distances>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <sibling id='0' value='10'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           </distances>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           <cpus num='12'>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='1' socket_id='1' die_id='1' core_id='0' siblings='1'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='2' socket_id='2' die_id='2' core_id='0' siblings='2'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='3' socket_id='3' die_id='3' core_id='0' siblings='3'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='4' socket_id='4' die_id='4' core_id='0' siblings='4'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='5' socket_id='5' die_id='5' core_id='0' siblings='5'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='6' socket_id='6' die_id='6' core_id='0' siblings='6'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='7' socket_id='7' die_id='7' core_id='0' siblings='7'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='8' socket_id='8' die_id='8' core_id='0' siblings='8'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='9' socket_id='9' die_id='9' core_id='0' siblings='9'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='10' socket_id='10' die_id='10' core_id='0' siblings='10'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:             <cpu id='11' socket_id='11' die_id='11' core_id='0' siblings='11'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:           </cpus>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:         </cell>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       </cells>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:     </topology>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:     <cache>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='0' level='3' type='both' size='32' unit='MiB' cpus='0'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='1' level='3' type='both' size='32' unit='MiB' cpus='1'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='2' level='3' type='both' size='32' unit='MiB' cpus='2'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='3' level='3' type='both' size='32' unit='MiB' cpus='3'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='4' level='3' type='both' size='32' unit='MiB' cpus='4'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='5' level='3' type='both' size='32' unit='MiB' cpus='5'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='6' level='3' type='both' size='32' unit='MiB' cpus='6'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='7' level='3' type='both' size='32' unit='MiB' cpus='7'/>
May 26 04:55:28.837810 np0000001388 nova-compute[98319]:       <bank id='8' level='3' type='both' size='32' unit='MiB' cpus='8'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <bank id='9' level='3' type='both' size='32' unit='MiB' cpus='9'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <bank id='10' level='3' type='both' size='32' unit='MiB' cpus='10'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <bank id='11' level='3' type='both' size='32' unit='MiB' cpus='11'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     </cache>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <secmodel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <model>apparmor</model>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <doi>0</doi>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     </secmodel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <secmodel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <model>dac</model>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <doi>0</doi>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <baselabel type='kvm'>+64055:+993</baselabel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <baselabel type='qemu'>+64055:+993</baselabel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     </secmodel>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:   </host>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <arch name='alpha'>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>clipper</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:     <arch name='armv6l'>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 26 04:55:28.838818 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 26 04:55:28.842476 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 26 04:55:28.844852 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:     <arch name='armv7l'>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-arm</emulator>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 26 04:55:28.846044 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 26 04:55:28.847272 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 26 04:55:28.849779 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:     <arch name='aarch64'>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.2</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='512'>virt</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-dc-scm-v1-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mori-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>ast2600-evb</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>borzoi</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tiogapass-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>spitz</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.7</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>nuri</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>romulus-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.0</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.0</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>npcm750-evb</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.10</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>rainier-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps3-an547</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.8</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-b1</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-pbx-a9</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatileab</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>kzm</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fby35-bmc</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>musca-a</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-3.1</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.1</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>smdkc210</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.11</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>imx25-pdk</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>stm32vldiscovery</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.9</machine>
May 26 04:55:28.852391 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>orangepi-pc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>z2</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-5.2</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='6'>xlnx-zcu102</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>tosa</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an500</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.12</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps2-an521</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>sabrelite</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an511</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>canon-a1100</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-eb</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>emcraft-sf2</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>realview-pb-a8</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>sbsa-ref</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>yosemitev2-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.0</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.0</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi1ap</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>palmetto-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sx1-v1</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n810</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g220a-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>n800</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>bletchley-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.1</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>tacoma-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.1</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>quanta-gsj</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>versatilepb</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>terrier</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mainstone</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>integratorcp</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-7.2</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-4.2</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>witherspoon-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>qcom-firework-bmc</machine>
May 26 04:55:28.854668 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>mps3-an524</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>kudo-bmc</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a9</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>midway</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>musicpal</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s811evb</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>lm3s6965evb</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>supermicro-x11spi-bmc</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>microbit</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='3'>fby35</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an505</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an385</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.0</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.0</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>raspi3ap</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cubieboard</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast1030-evb</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>verdex</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>bpim2u</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduino2</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>xlnx-versal-virt</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mps2-an386</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>olimex-stm32-h405</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.1</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-8.1</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>raspi3b</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>raspi2b</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>vexpress-a15</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='2'>fuji-bmc</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt-6.2</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sonorapass-bmc</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>cheetah</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>virt-2.6</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ast2500-evb</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>highbank</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>akita</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>connex</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>netduinoplus2</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>collie</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>raspi0</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.855790 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     <arch name='cris'>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-cris</emulator>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>axis-dev88</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:     <arch name='i686'>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-i386</emulator>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 26 04:55:28.856932 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>x-remote</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 26 04:55:28.859766 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>isapc</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 26 04:55:28.861720 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>microvm</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 26 04:55:28.863569 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <domain type='kvm'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <pae/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <nonpae/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <apic default='on' toggle='no'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <arch name='m68k'>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mcf5208evb</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-7.0</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>an5206</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-6.0</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>q800</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-8.1</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-7.2</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-6.2</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-8.0</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>next-cube</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-7.1</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-6.1</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virt-8.2</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine canonical='virt-8.2' maxCpus='1'>virt</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <arch name='microblaze'>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:     <arch name='microblazeel'>
May 26 04:55:28.866174 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>petalogix-ml605</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <arch name='mips'>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips</emulator>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <arch name='mipsel'>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <arch name='mips64'>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>pica61</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>magnum</machine>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:     <arch name='mips64el'>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
May 26 04:55:28.868075 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>malta</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>loongson3-virt</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mipssim</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>pica61</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>magnum</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='16'>boston</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>fuloong2e</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <arch name='ppc'>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:     <arch name='ppc64'>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-noble</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv9</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 26 04:55:28.871658 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv10</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-focal</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-disco</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 26 04:55:28.873091 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-impish</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-artful</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv8</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:     <arch name='ppc64le'>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-noble</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine canonical='pseries-noble' maxCpus='4096'>pseries</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>amigaone</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv9</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.1</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='15'>mpc8544ds</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.1</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.5</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv10</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-xenial</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.2</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.2</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-yakkety</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.6</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ppce500</machine>
May 26 04:55:28.876085 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic-sxxm</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.7</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.0</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.0</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.0</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>40p</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-lunar</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.8</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>pegasos2</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-hirsute</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-3.1</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.1</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.1</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-eoan</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.9</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-zesty</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>bamboo</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-groovy</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-focal</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>g3beige</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-8.2</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-5.2</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-disco</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12-sxxm</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-mantic</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-kinetic</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.10</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.0</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>virtex-ml507</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.11</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.1</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.1</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-cosmic</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-bionic</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.12</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.2</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-7.2</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>mac99</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-impish</machine>
May 26 04:55:28.878691 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-jammy</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-artful</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sam460ex</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>ref405ep</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.3</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='2048'>powernv8</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-4.0</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-6.0</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='4096'>pseries-2.4</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <arch name='riscv32'>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='8'>spike</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>opentitan</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='5'>sifive_u</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sifive_e</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <arch name='riscv64'>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='512'>virt</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='8'>spike</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='5'>sifive_u</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>shakti_c</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sifive_e</machine>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:     <arch name='s390x'>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
May 26 04:55:28.881694 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-noble</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine canonical='s390-ccw-virtio-noble' maxCpus='248'>s390-ccw-virtio</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-mantic</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.2</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.2</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-lunar</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-kinetic</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-8.1</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
May 26 04:55:28.883325 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-7.1</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <arch name='sh4'>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>shix</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>r2d</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <arch name='sh4eb'>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>shix</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>r2d</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:     <arch name='sparc'>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>SS-5</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>SS-20</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>LX</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>SPARCClassic</machine>
May 26 04:55:28.883928 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>leon3_generic</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>SPARCbook</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>SS-4</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>SS-600MP</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>SS-10</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>Voyager</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <arch name='sparc64'>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sun4u</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>niagara</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>sun4v</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:     <arch name='x86_64'>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <wordsize>64</wordsize>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble-v2</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-noble-v2' maxCpus='255'>ubuntu</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.2</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar-hpb</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.0</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.2</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-maxcpus</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
May 26 04:55:28.884999 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-xenial</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.7</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-lunar</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-hpb-maxcpus</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-artful</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-trusty</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.2</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-maxcpus</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-mantic-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-i440fx-jammy-maxcpus</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.4</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.10</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>x-remote</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.1</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.9</machine>
May 26 04:55:28.885859 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb-maxcpus</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-eoan</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='1'>isapc</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.6</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-mantic-maxcpus</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-bionic</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.12</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-kinetic-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.0</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble-v2</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-noble-v2' maxCpus='1024'>ubuntu-q35</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-lunar-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-disco</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.1</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-noble</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-noble' maxCpus='1024'>q35</machine>
May 26 04:55:28.886447 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-8.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-5.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.8</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-3.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-zesty</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-7.2</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-4.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-focal</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>microvm</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255' deprecated='yes'>pc-i440fx-2.3</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-jammy-hpb-maxcpus</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-kinetic-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-noble</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-noble' maxCpus='255'>pc</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='1024'>pc-q35-8.2</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine canonical='pc-q35-8.2' maxCpus='1024'>q35</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-8.2</machine>
May 26 04:55:28.887076 np0000001388 nova-compute[98319]:       <machine canonical='pc-i440fx-8.2' maxCpus='255'>pc</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-6.2</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-2.5</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-mantic-hpb-maxcpus</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='255'>pc-i440fx-7.2</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='288'>pc-q35-2.11</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <domain type='kvm'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <acpi default='on' toggle='yes'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <apic default='on' toggle='no'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <arch name='xtensa'>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>sim</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>kc705</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ml605</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ml605-nommu</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>virt</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx60-nommu</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx200</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx200-nommu</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx60</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>kc705-nommu</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:   <guest>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <os_type>hvm</os_type>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:     <arch name='xtensaeb'>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <wordsize>32</wordsize>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='4'>sim</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>kc705</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ml605</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>ml605-nommu</machine>
May 26 04:55:28.887635 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>virt</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx60-nommu</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx200</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx200-nommu</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>lx60</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <machine maxCpus='32'>kc705-nommu</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <domain type='qemu'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     </arch>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <features>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <cpuselection/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <deviceboot/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <disksnapshot default='on' toggle='no'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <externalSnapshot/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     </features>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   </guest>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]: </capabilities>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]: 
May 26 04:55:28.888771 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.888771 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None:
May 26 04:55:28.888771 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-alpha</path>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <machine>clipper</machine>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <arch>alpha</arch>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <vcpu max='4'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.888771 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.889703 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.891726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.891726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None:
May 26 04:55:28.891726 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <machine>virt-8.2</machine>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <arch>armv6l</arch>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.891726 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 26 04:55:28.892696 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.893386 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <gic supported='yes'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       <enum name='version'>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>2</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:         <value>3</value>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     </gic>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.894523 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.895738 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt:
May 26 04:55:28.895738 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <machine>virt-8.2</machine>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <arch>armv6l</arch>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 26 04:55:28.895738 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.896446 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.897298 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <gic supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='version'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>2</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>3</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </gic>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.898433 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.898433 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt:
May 26 04:55:28.898433 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-arm</path>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <machine>virt-8.2</machine>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <arch>armv7l</arch>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.898433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 26 04:55:28.899412 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.900507 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     <gic supported='yes'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       <enum name='version'>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>2</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:         <value>3</value>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.901543 np0000001388 nova-compute[98319]:     </gic>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.904144 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.904144 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt:
May 26 04:55:28.904144 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-aarch64</path>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <machine>virt-8.2</machine>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <arch>aarch64</arch>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.ms.fd</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.secboot.fd</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.no-secboot.fd</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-n2</model>
May 26 04:55:28.904144 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c0</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a15</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b0</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a57</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m4</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a0</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1176</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-b1</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a7</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-a1</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a76</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>a64fx</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a8</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-v1</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>ti925t</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r5f</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1026</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a9</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m7</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa260</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa250</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa270-c5</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa261</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa262</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a710</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1110</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-r52</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sa1100</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a53</model>
May 26 04:55:28.905337 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m0</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m33</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a72</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm946</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>pxa255</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a55</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm11mpcore</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m55</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>neoverse-n1</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm926</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-a35</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>arm1136-r2</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>cortex-m3</model>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.905929 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:     <gic supported='yes'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:       <enum name='version'>
May 26 04:55:28.907247 np0000001388 nova-compute[98319]:         <value>2</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>3</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     </gic>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.908607 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.908607 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None:
May 26 04:55:28.908607 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-cris</path>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <machine>axis-dev88</machine>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <arch>cris</arch>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.908607 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.909818 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.911391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for i686 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.911391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
May 26 04:55:28.911391 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <machine>pc-q35-noble</machine>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <arch>i686</arch>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <vcpu max='1024'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.911391 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 26 04:55:28.912191 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.912836 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.913411 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.914358 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.916452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
May 26 04:55:28.916452 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <machine>pc-i440fx-noble</machine>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <arch>i686</arch>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <vcpu max='255'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.916452 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.917444 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.918080 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.918598 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.919540 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.920681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
May 26 04:55:28.920681 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <machine>pc-q35-noble-v2</machine>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <arch>i686</arch>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <vcpu max='1024'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.920681 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.921664 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.922346 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.922815 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.923859 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.925042 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
May 26 04:55:28.925042 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-i386</path>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <machine>pc-i440fx-noble-v2</machine>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <arch>i686</arch>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <vcpu max='255'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.925042 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='lm'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>qemu64</model>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.926072 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='unknown'>kvm64</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>core2duo</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Penryn</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.926742 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Conroe</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.927268 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.928097 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.930841 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.930841 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None:
May 26 04:55:28.930841 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-m68k</path>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <machine>mcf5208evb</machine>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <arch>m68k</arch>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.930841 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.931709 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.932899 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt:
May 26 04:55:28.932899 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-m68k</path>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <machine>virt-8.2</machine>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <arch>m68k</arch>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.932899 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.933860 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.935014 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.935014 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None:
May 26 04:55:28.935014 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-microblaze</path>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <machine>petalogix-s3adsp1800</machine>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <arch>microblaze</arch>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.935014 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.935967 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.937133 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.937133 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None:
May 26 04:55:28.937133 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-microblazeel</path>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <machine>petalogix-s3adsp1800</machine>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <arch>microblazeel</arch>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.937133 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.937980 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.939347 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.939347 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None:
May 26 04:55:28.939347 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips</path>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <machine>malta</machine>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <arch>mips</arch>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <vcpu max='16'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.939347 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.940315 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.941579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.941579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None:
May 26 04:55:28.941579 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-mipsel</path>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <machine>malta</machine>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <arch>mipsel</arch>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <vcpu max='16'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.941579 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.942559 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.943963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.943963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None:
May 26 04:55:28.943963 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips64</path>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <machine>malta</machine>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <arch>mips64</arch>
May 26 04:55:28.943963 np0000001388 nova-compute[98319]:   <vcpu max='16'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.944901 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.946022 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.947037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.947037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None:
May 26 04:55:28.947037 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-mips64el</path>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <machine>malta</machine>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <arch>mips64el</arch>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <vcpu max='16'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.947037 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.947949 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.949047 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.949047 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None:
May 26 04:55:28.949047 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc</path>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <machine>g3beige</machine>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <arch>ppc</arch>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.949047 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.949992 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.952116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for ppc64 via machine types: {None, 'pseries', 'powernv'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.952116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None:
May 26 04:55:28.952116 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <machine>pseries-noble</machine>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <arch>ppc64</arch>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <vcpu max='4096'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.952116 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.953026 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>tpm-spapr</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.954353 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.955433 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries:
May 26 04:55:28.955433 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <machine>pseries-noble</machine>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <arch>ppc64</arch>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <vcpu max='4096'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.955433 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>tpm-spapr</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.956509 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.957742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv:
May 26 04:55:28.957742 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64</path>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <machine>powernv9</machine>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <arch>ppc64</arch>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <vcpu max='2048'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.957742 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.958743 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>tpm-spapr</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.959984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.959984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries:
May 26 04:55:28.959984 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 26 04:55:28.959984 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <machine>pseries-noble</machine>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <arch>ppc64le</arch>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <vcpu max='4096'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.961041 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>tpm-spapr</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.962162 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.963454 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv:
May 26 04:55:28.963454 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-ppc64le</path>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <machine>powernv9</machine>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <arch>ppc64le</arch>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <vcpu max='2048'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER10</model>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER9</model>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER8</model>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='IBM'>POWER7</model>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.963454 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>tpm-spapr</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:         <value>spapr-tpm-proxy</value>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.964503 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.965885 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.965885 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None:
May 26 04:55:28.965885 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-riscv32</path>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <machine>virt</machine>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <arch>riscv32</arch>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.965885 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.966892 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.968092 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.969241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.969241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None:
May 26 04:55:28.969241 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-riscv64</path>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <machine>virt</machine>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <arch>riscv64</arch>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <vcpu max='512'/>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>rv64</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sifive-e51</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>any</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>x-rv128</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>shakti-c</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>max</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>thead-c906</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>sifive-u54</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:       <model usable='unknown' vendor='unknown'>veyron-v1</model>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.969241 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.969987 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.971080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.971080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio:
May 26 04:55:28.971080 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-s390x</path>
May 26 04:55:28.971080 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <machine>s390-ccw-virtio-noble</machine>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <arch>s390x</arch>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <vcpu max='248'/>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.3</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.2</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196.2-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14.2-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.4</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC.2-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z114-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16b</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.3-base</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16a</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.5</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196.2</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12.2</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.2</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC</model>
May 26 04:55:28.971991 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.3-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z800-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14ZR1-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.4-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.3</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13.2</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC.2</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15a-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14.2</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zBC12-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16a-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.3</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z196-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.2</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z800</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z14ZR1</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.2</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.2-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.2-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.3</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.5-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>max</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15b</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC.2-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15a</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.2-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen16b-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z114</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC-base</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13s</model>
May 26 04:55:28.972905 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>gen15b-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.3</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10EC.3-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.2-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890.2</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zEC12.2-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z890-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z10BC</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9EC.2-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13.2-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='IBM'>z900.3-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990.3-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z13s-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>zBC12</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z990-base</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <model usable='no' vendor='IBM'>z9BC.2</model>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.973521 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <s390-pv supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.974510 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.975783 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.975783 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None:
May 26 04:55:28.975783 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-sh4</path>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <machine>shix</machine>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <arch>sh4</arch>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.975783 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.976720 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.977871 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.977871 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None:
May 26 04:55:28.977871 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-sh4eb</path>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <machine>shix</machine>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <arch>sh4eb</arch>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.977871 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.978713 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.979826 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.979826 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None:
May 26 04:55:28.979826 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-sparc</path>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <machine>SS-5</machine>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <arch>sparc</arch>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.979826 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <redirdev supported='no'/>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.980754 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='model'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.981984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.981984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None:
May 26 04:55:28.981984 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-sparc64</path>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <machine>sun4u</machine>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <arch>sparc64</arch>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <vcpu max='1'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:28.981984 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.982849 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.984108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'pc', 'ubuntu-q35', 'ubuntu'} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:28.984108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
May 26 04:55:28.984108 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <machine>pc-q35-noble</machine>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <arch>x86_64</arch>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <vcpu max='1024'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.984108 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.985080 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.985902 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.986472 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.987144 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.988350 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
May 26 04:55:28.988350 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   <machine>pc-i440fx-noble</machine>
May 26 04:55:28.988350 np0000001388 nova-compute[98319]:   <arch>x86_64</arch>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:   <vcpu max='255'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.989405 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.990640 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.991310 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.991933 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.993095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
May 26 04:55:28.993095 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.993095 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <machine>pc-q35-noble-v2</machine>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <arch>x86_64</arch>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <vcpu max='1024'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <value>/usr/share/ovmf/OVMF.amdsev.fd</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.994104 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.994966 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:28.995587 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:28.996220 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:28.997376 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:28.998532 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
May 26 04:55:28.998532 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-x86_64</path>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <machine>pc-i440fx-noble-v2</machine>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <arch>x86_64</arch>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <vcpu max='255'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     <enum name='firmware'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <value>efi</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='yes'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <enum name='maximumMigratable'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>on</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:         <value>off</value>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='yes'>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <model fallback='forbid'>EPYC</model>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <vendor>AMD</vendor>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='acpi'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='ss'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='monitor'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='hypervisor'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='erms'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='mpx'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='pcommit'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='clwb'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='umip'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='pku'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='vaes'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='la57'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='rdpid'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='pks'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrm'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='fzrm'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrs'/>
May 26 04:55:28.998532 np0000001388 nova-compute[98319]:       <feature policy='require' name='fsrc'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnowext'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='3dnow'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='xsaveerptr'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='wbnoinvd'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='npt'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='vgif'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='require' name='svme-addr-chk'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='vme'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='xsavec'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='fxsr_opt'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='misalignsse'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='osvw'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='topoext'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <feature policy='disable' name='nrip-save'/>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:     <mode name='custom' supported='yes'>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu64</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>qemu32</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>phenom</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium3</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium2</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>pentium</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>n270</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm64</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>kvm32</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>coreduo</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>core2duo</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>athlon</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Westmere-IBRS</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Westmere</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Snowridge</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-noTSX-IBRS</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server-IBRS</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Server</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-noTSX-IBRS</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client-IBRS</model>
May 26 04:55:28.999335 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Skylake-Client</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SapphireRapids</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>SandyBridge</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Penryn</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G5</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G4</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>Opteron_G3</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G2</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='AMD'>Opteron_G1</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Nehalem-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Nehalem</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>IvyBridge</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server-noTSX</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Icelake-Server</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-noTSX</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Haswell</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Rome</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Milan</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-IBPB</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC-Genoa</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='AMD'>EPYC</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Hygon'>Dhyana</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cooperlake</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='Intel'>Conroe</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server-noTSX</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Cascadelake-Server</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-noTSX</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell-IBRS</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='no' vendor='Intel'>Broadwell</model>
May 26 04:55:28.999886 np0000001388 nova-compute[98319]:       <model usable='yes' vendor='unknown'>486</model>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </mode>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>ide</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>vmvga</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>qxl</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>ramfb</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.000484 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <tpm supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>tpm-tis</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>tpm-crb</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>passthrough</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>emulator</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>external</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='backendVersion'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>1.2</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>2.0</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </tpm>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='yes'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <genid supported='yes'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     <hyperv supported='yes'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       <enum name='features'>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>relaxed</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>vapic</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>spinlocks</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>vpindex</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>runtime</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>synic</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>stimer</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>reset</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>vendor_id</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>frequencies</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>reenlightenment</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>tlbflush</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>ipi</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:         <value>avic</value>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:     </hyperv>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:29.001700 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:29.002867 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:29.002867 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None:
May 26 04:55:29.002867 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-xtensa</path>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <machine>sim</machine>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <arch>xtensa</arch>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <vcpu max='4'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.002867 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:29.004130 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:29.005408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98319) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1020}}
May 26 04:55:29.005408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None:
May 26 04:55:29.005408 np0000001388 nova-compute[98319]: <domainCapabilities>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <path>/usr/bin/qemu-system-xtensaeb</path>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <domain>qemu</domain>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <machine>sim</machine>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <arch>xtensaeb</arch>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <vcpu max='4'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <iothreads supported='yes'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <os supported='yes'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <enum name='firmware'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <loader supported='yes'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>rom</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>pflash</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <enum name='readonly'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>yes</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <enum name='secure'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:         <value>no</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     </loader>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   </os>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <cpu>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <mode name='host-passthrough' supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <mode name='maximum' supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <mode name='host-model' supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <mode name='custom' supported='no'/>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <memoryBacking supported='yes'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <enum name='sourceType'>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <value>file</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <value>anonymous</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:       <value>memfd</value>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     </enum>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   </memoryBacking>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:   <devices>
May 26 04:55:29.005408 np0000001388 nova-compute[98319]:     <disk supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='diskDevice'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>disk</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>cdrom</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>floppy</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>lun</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>fdc</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>sata</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </disk>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <graphics supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>sdl</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>vnc</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>spice</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>egl-headless</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>dbus</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </graphics>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <video supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='modelType'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>vga</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>cirrus</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>none</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>bochs</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </video>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <hostdev supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='mode'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>subsystem</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='startupPolicy'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>default</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>mandatory</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>requisite</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>optional</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='subsysType'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>pci</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>scsi</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='capsType'/>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='pciBackend'/>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </hostdev>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <rng supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio-transitional</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtio-non-transitional</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>random</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>egd</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </rng>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <filesystem supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='driverType'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>path</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>handle</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:         <value>virtiofs</value>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     </filesystem>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <tpm supported='no'/>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:     <redirdev supported='yes'>
May 26 04:55:29.006344 np0000001388 nova-compute[98319]:       <enum name='bus'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>usb</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     </redirdev>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <channel supported='yes'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>pty</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>unix</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>spicevmc</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     </channel>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <crypto supported='yes'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       <enum name='model'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>virtio</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       <enum name='type'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>qemu</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       <enum name='backendModel'>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:         <value>builtin</value>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:       </enum>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     </crypto>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:   </devices>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:   <features>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <gic supported='no'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <vmcoreinfo supported='no'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <genid supported='no'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <backingStoreInput supported='yes'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <backup supported='yes'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <async-teardown supported='yes'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <sev supported='no'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:     <sgx supported='no'/>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:   </features>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]: </domainCapabilities>
May 26 04:55:29.007555 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1105}}
May 26 04:55:29.007555 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Checking secure boot support for host arch (x86_64) {{(pid=98319) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1962}}
May 26 04:55:29.007555 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Secure Boot support detected
May 26 04:55:29.478280 np0000001388 nova-compute[98319]: INFO nova.virt.node [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Generated node identity 532664ff-66ca-4f17-bdd2-18f1300079ea
May 26 04:55:29.478510 np0000001388 nova-compute[98319]: INFO nova.virt.node [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Wrote node identity 532664ff-66ca-4f17-bdd2-18f1300079ea to /opt/stack/data/nova/compute_id
May 26 04:55:29.980763 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Compute nodes ['532664ff-66ca-4f17-bdd2-18f1300079ea'] for host np0000001388 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
May 26 04:55:30.984590 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
May 26 04:55:31.989017 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] No compute node record found for host np0000001388. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000001388 could not be found.
May 26 04:55:31.989483 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:55:31.989483 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:55:31.989557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:55:31.989654 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 04:55:32.042581 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:55:32.043410 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:55:32.057247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] CMD "env LANG=C uptime" returned: 0 in 0.013s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:55:32.057602 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=16711MB free_disk=75.21772384643555GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 04:55:32.057764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:55:32.058040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:55:32.561224 np0000001388 nova-compute[98319]: WARNING nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] No compute node record for np0000001388:532664ff-66ca-4f17-bdd2-18f1300079ea: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 532664ff-66ca-4f17-bdd2-18f1300079ea could not be found.
May 26 04:55:33.065534 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Compute node record created for np0000001388:np0000001388 with uuid: 532664ff-66ca-4f17-bdd2-18f1300079ea
May 26 04:55:34.574942 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 04:55:34.574942 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:55:32 up 27 min,  2 users,  load average: 2.72, 1.53, 0.76\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 04:55:35.058030 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] [req-205d4e7e-1d91-4dd6-83bb-9ba331b44dc3] Created resource provider record via placement API for resource provider with UUID 532664ff-66ca-4f17-bdd2-18f1300079ea and name np0000001388.
May 26 04:55:35.122086 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] /sys/module/kvm_amd/parameters/sev contains [N
May 26 04:55:35.122086 np0000001388 nova-compute[98319]: ] {{(pid=98319) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2038}}
May 26 04:55:35.122189 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.host [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] kernel doesn't support AMD SEV
May 26 04:55:35.122412 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:55:35.122568 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 04:55:35.122816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:55:35.127154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Libvirt baseline CPU <cpu>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:   <arch>x86_64</arch>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:   <model>Nehalem</model>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:   <vendor>AMD</vendor>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:   <topology sockets="12" cores="1" threads="1"/>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:   <maxphysaddr mode="emulate" bits="40"/>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]: </cpu>
May 26 04:55:35.127154 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13740}}
May 26 04:55:35.686687 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Updated inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 24030, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}}
May 26 04:55:35.687104 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Updating resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea generation from 0 to 1 during operation: update_inventory {{(pid=98319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 26 04:55:35.687104 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 04:55:35.816972 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Updating resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea generation from 1 to 2 during operation: update_traits {{(pid=98319) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
May 26 04:55:36.325577 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 04:55:36.325777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.268s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:55:36.325978 np0000001388 nova-compute[98319]: DEBUG nova.service [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98319) start /opt/stack/nova/nova/service.py:195}}
May 26 04:55:36.343090 np0000001388 nova-compute[98319]: DEBUG nova.service [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98319) start /opt/stack/nova/nova/service.py:211}}
May 26 04:55:36.358694 np0000001388 nova-compute[98319]: DEBUG nova.service [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] Join ServiceGroup membership for this service compute {{(pid=98319) start /opt/stack/nova/nova/service.py:221}}
May 26 04:55:36.359071 np0000001388 nova-compute[98319]: DEBUG nova.servicegroup.drivers.db [None req-03b27fdc-7ea7-4ce8-9e2d-30a30d9ae3e1 None None] DB_Driver: join new ServiceGroup member np0000001388 to the compute group, service = <Service: host=np0000001388, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=98319) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
May 26 04:55:41.862690 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:55:51.360758 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:55:51.864169 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:55:51.865163 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.75 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:56:15.618688 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.619153 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.619249 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.619502 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.619801 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.620001 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.620211 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:15.620358 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 04:56:15.620530 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:56:16.123977 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:56:16.124143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:56:16.124338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:56:16.124506 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 04:56:16.132540 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:56:16.133421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:56:16.149236 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.016s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:56:16.149762 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=16481MB free_disk=75.06752014160156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 04:56:16.149918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:56:16.150171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:56:17.212272 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 04:56:17.212788 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:56:16 up 28 min,  2 users,  load average: 2.01, 1.52, 0.79\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 04:56:17.253032 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:56:17.253315 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:56:17.756114 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:56:18.262854 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 04:56:18.263508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:56:18.263508 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 59.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:57:18.144914 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.145497 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.145497 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.145725 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.145914 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.146128 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.146352 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.146557 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.146713 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 04:57:18.146942 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:57:18.650282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:18.650475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:18.650653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:18.650832 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 04:57:18.659073 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:57:18.659909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:18.676733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.017s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:18.677100 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=16607MB free_disk=74.88533401489258GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 04:57:18.677305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:18.677479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:19.726148 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 04:57:19.726689 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:57:18 up 29 min,  2 users,  load average: 1.24, 1.40, 0.80\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 04:57:19.780555 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:57:19.780834 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:57:20.283494 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:57:20.790780 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 04:57:20.791340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.113s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:20.791392 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:57:41.866824 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:57:46.090418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:46.091703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:46.112584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:46.112745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:46.592765 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:57:46.616170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:57:47.179017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:47.179416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:47.181349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:47.183707 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:57:47.183907 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Claim successful on node np0000001388
May 26 04:57:48.358986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:57:48.359427 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:57:48.863465 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:57:49.369764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.190s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:49.370550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.189s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:49.370736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:57:49.376367 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:57:49.376554 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Claim successful on node np0000001388
May 26 04:57:49.876115 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:57:49.877959 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:57:49.879696 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:49.879999 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:50.383506 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:57:50.514638 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:57:50.514818 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:57:50.634730 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73836ad692a5416ba794954c66b65818', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd18b0374cd494e1ba0a0dfbfa4ad5bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:57:50.888739 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:57:51.017596 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:57:51.524292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.154s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:51.524776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:57:51.902285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:57:51.908216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:57:51.908216 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Creating image(s)
May 26 04:57:51.908216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:51.908216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:51.908216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:51.909186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:51.911515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:52.021302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:52.021302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:52.031719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:57:52.032385 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:57:52.032902 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:52.033179 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:52.230531 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Successfully created port: 26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:57:52.358003 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d25c63261bb45f1bc8ab1e39768c377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f7e0bdf71e47a9b6de4e03f880f492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:57:52.522473 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:57:52.532401 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:57:52.788373 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:52.791962 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:52.792313 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:52.863015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.part --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:52.863769 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] eb1b37ef-ecaa-41a5-b927-a074eae64cb1 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 04:57:52.864473 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 04:57:52.864824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.part /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:53.025854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.part /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.converted" returned: 0 in 0.161s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:53.030948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:53.041971 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:57:53.094060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d.converted --force-share --output=json" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:53.094729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.183s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:53.095612 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:53.100318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:53.100601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:53.101536 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:53.104723 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:57:53.106435 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Claim successful on node np0000001388
May 26 04:57:53.108434 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpy09660jn/privsep.sock']
May 26 04:57:53.118503 np0000001388 sudo[109513]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpy09660jn/privsep.sock
May 26 04:57:53.120229 np0000001388 sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 26 04:57:53.411021 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 26 04:57:53.411138 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:57:53.411556 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:57:53.411556 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:53.411556 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:57:53.411556 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:57:53.411556 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:57:53.411855 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:53.411855 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 26 04:57:53.604230 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Successfully created port: c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:57:53.767117 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 26 04:57:53.767117 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:57:53.767117 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:57:53.767541 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:53.767541 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:57:53.767541 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:57:53.767541 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:57:53.767716 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:53.767716 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 26 04:57:54.028245 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Successfully updated port: 26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:57:54.052549 np0000001388 sudo[109513]: pam_unix(sudo:session): session closed for user root
May 26 04:57:54.053987 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Spawned new privsep daemon via rootwrap
May 26 04:57:54.055800 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:57:54.058064 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 26 04:57:54.058238 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 26 04:57:54.058622 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
May 26 04:57:54.058888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:57:54.059043 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109518
May 26 04:57:54.059620 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Creating image(s)
May 26 04:57:54.060347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:54.060602 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:54.062694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:54.062694 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.065874 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.130218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.131037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.215484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.215484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:54.215484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:54.216130 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.222688 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.224692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.237658 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.239647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:54.325420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.325890 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.375536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk 1073741824" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.376603 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:54.377013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.377984 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:54.390133 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.393890 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:54.394498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.460736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.461963 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:57:54.462789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.500873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:57:54.500873 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:57:54.506174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.507481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.531646 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:54.531819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquired lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:57:54.531926 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:57:54.552521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.553374 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Cannot resize image /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:57:54.553997 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:57:54.554213 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Ensure instance console log exists: /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:57:54.555281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk 1073741824" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.555627 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.178s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:54.556013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.563257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:54.563473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:54.565779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:54.637723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.638619 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:57:54.638921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:54.720443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:54.720931 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Cannot resize image /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:57:54.721496 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:57:54.721727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Ensure instance console log exists: /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:57:54.722091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:54.722608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:54.722608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:55.006070 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:57:55.494398 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Successfully updated port: c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:57:55.515448 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.415s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:55.516223 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:57:55.997427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:55.997427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:57:55.997427 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:57:56.023429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:57:56.023573 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:57:56.023942 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:56.024294 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:56.036134 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:57:56.226681 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-changed-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:57:56.227170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Refreshing instance network info cache due to event network-changed-26ab0a2f-caaf-46e0-b94d-c475f871c790. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:57:56.227170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] Acquiring lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:56.338331 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e403f092f91b47c1b1e6664b4f806bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e44351e7dfd4870bf0073b5f95c0423', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:57:56.523905 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:57:57.026632 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:57:57.064282 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:57:57.678153 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:57.778923 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Successfully created port: a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:57:58.002332 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updating instance_info_cache with network_info: [{"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:57:58.019448 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:58.041953 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:57:58.042449 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:57:58.042720 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Creating image(s)
May 26 04:57:58.043280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:58.043462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:58.043968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:58.044683 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:58.047848 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:58.049492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:58.131940 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:58.132788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:58.133468 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:58.133754 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:58.140381 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:57:58.141008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:58.206783 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Updating instance_info_cache with network_info: [{"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:57:58.226717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:58.227320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:58.259631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk 1073741824" returned: 0 in 0.032s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:58.260146 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:58.260501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:58.330551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:58.330977 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:57:58.331296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:57:58.376097 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received event network-changed-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:57:58.376293 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Refreshing instance network info cache due to event network-changed-c81ef482-06df-40d2-b7a8-f9579f4420e4. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:57:58.376488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Acquiring lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:58.410589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.079s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:57:58.412258 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Cannot resize image /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:57:58.412587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:57:58.412761 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Ensure instance console log exists: /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:57:58.413028 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:58.413176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:58.413372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:58.418966 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Successfully updated port: a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:57:58.507001 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Releasing lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:57:58.507397 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Instance network_info: |[{"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:57:58.507696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] Acquired lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:57:58.507827 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Refreshing network info cache for port 26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:57:58.514031 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Start _get_guest_xml network_info=[{"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:57:58.517362 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:57:58.521087 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-1175059357', uuid='8a4df71c-706b-4393-a8aa-fdffa726dbda'), owner=OwnerMeta(userid='73836ad692a5416ba794954c66b65818', username='tempest-DeleteServersTestJSON-81488332-project-member', projectid='d18b0374cd494e1ba0a0dfbfa4ad5bfb', projectname='tempest-DeleteServersTestJSON-81488332'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771478.5198977) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:57:58.523043 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:57:58.523043 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:57:58.524325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:57:58.524325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:57:58.525838 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:57:58.526343 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:57:58.526556 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:57:58.526713 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:57:58.526911 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:57:58.527051 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:57:58.527337 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:57:58.527586 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:57:58.527769 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:57:58.528224 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:57:58.528692 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:57:58.528889 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:57:58.546068 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 04:57:58.547453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175059357',display_name='tempest-DeleteServersTestJSON-server-1175059357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-deleteserverstestjson-server-1175059357',id=1,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18b0374cd494e1ba0a0dfbfa4ad5bfb',ramdisk_id='',reservation_id='r-fer10w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-81488332',owner_user_name='tempest-DeleteServersTestJSON-81488332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:51Z,user_data=None,user_id='73836ad692a5416ba794954c66b65818',uuid=8a4df71c-706b-4393-a8aa-fdffa726dbda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:57:58.547742 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converting VIF {"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:57:58.548953 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:57:58.550543 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a4df71c-706b-4393-a8aa-fdffa726dbda {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:57:58.710146 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:57:58.710640 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Instance network_info: |[{"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:57:58.711113 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Acquired lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:57:58.711351 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Refreshing network info cache for port c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:57:58.714135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Start _get_guest_xml network_info=[{"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:57:58.717234 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:57:58.718704 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1945830772', uuid='23a26816-a71d-42c9-8061-d464d5058a92'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771478.718281) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:57:58.720006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:57:58.720525 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:57:58.721256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:57:58.721491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:57:58.722538 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:57:58.722953 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:57:58.723188 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:57:58.723325 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:57:58.723452 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:57:58.723708 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:57:58.723805 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:57:58.724099 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:57:58.724209 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:57:58.724391 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:57:58.724544 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:57:58.726270 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:57:58.736689 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945830772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945830772',id=2,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-3p44ecdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:53Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=23a26816-a71d-42c9-8061-d464d5058a92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:57:58.736930 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:57:58.737509 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:57:58.737937 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid 23a26816-a71d-42c9-8061-d464d5058a92 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:57:58.921634 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:58.921747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:57:58.921842 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:57:58.950312 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-changed-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:57:58.950453 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Refreshing instance network info cache due to event network-changed-a1df6515-d249-4964-8dc0-e810a2fa8446. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:57:58.950615 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:57:59.011049 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:59.055659 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] End _get_guest_xml xml=<domain type="qemu">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <uuid>8a4df71c-706b-4393-a8aa-fdffa726dbda</uuid>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <name>instance-00000001</name>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:name>tempest-DeleteServersTestJSON-server-1175059357</nova:name>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:57:58</nova:creationTime>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:user uuid="73836ad692a5416ba794954c66b65818">tempest-DeleteServersTestJSON-81488332-project-member</nova:user>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:project uuid="d18b0374cd494e1ba0a0dfbfa4ad5bfb">tempest-DeleteServersTestJSON-81488332</nova:project>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         <nova:port uuid="26ab0a2f-caaf-46e0-b94d-c475f871c790">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <system>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="serial">8a4df71c-706b-4393-a8aa-fdffa726dbda</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="uuid">8a4df71c-706b-4393-a8aa-fdffa726dbda</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </system>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <os>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </os>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <features>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </features>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   <devices>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </disk>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.config"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </disk>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:17:78:67"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <target dev="tap26ab0a2f-ca"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </interface>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/console.log" append="off"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </serial>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <video>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </video>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </rng>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:   </devices>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]: </domain>
May 26 04:57:59.055659 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:57:59.061263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Preparing to wait for external event network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:57:59.061263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:59.061263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:59.061263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:59.061263 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175059357',display_name='tempest-DeleteServersTestJSON-server-1175059357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-deleteserverstestjson-server-1175059357',id=1,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d18b0374cd494e1ba0a0dfbfa4ad5bfb',ramdisk_id='',reservation_id='r-fer10w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-81488332',owner_user_name='tempest-DeleteServersTestJSON-81488332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:51Z,user_data=None,user_id='73836ad692a5416ba794954c66b65818',uuid=8a4df71c-706b-4393-a8aa-fdffa726dbda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:57:59.061617 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converting VIF {"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:57:59.061617 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:57:59.061617 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:57:59.101942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Created schema index Interface.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 26 04:57:59.102172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Created schema index Port.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 26 04:57:59.102172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Created schema index Bridge.name {{(pid=98319) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
May 26 04:57:59.103127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 04:57:59.103127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [POLLOUT] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.103127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 04:57:59.103439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.104665 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.121791 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.137583 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.137829 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:57:59.138130 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:57:59.138930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.139150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '775c3ef9-48ab-56e5-8bbf-8547f85f04bf', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:57:59.143984 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.144771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.146099 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpaoeuc1hg/privsep.sock']
May 26 04:57:59.154365 np0000001388 sudo[109672]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpaoeuc1hg/privsep.sock
May 26 04:57:59.155150 np0000001388 sudo[109672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 26 04:57:59.216805 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:59.240963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] End _get_guest_xml xml=<domain type="qemu">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <uuid>23a26816-a71d-42c9-8061-d464d5058a92</uuid>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <name>instance-00000002</name>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1945830772</nova:name>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:57:58</nova:creationTime>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         <nova:port uuid="c81ef482-06df-40d2-b7a8-f9579f4420e4">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <system>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="serial">23a26816-a71d-42c9-8061-d464d5058a92</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="uuid">23a26816-a71d-42c9-8061-d464d5058a92</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </system>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <os>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </os>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <features>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </features>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   <devices>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </disk>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.config"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </disk>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:17:29:9f"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <target dev="tapc81ef482-06"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </interface>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/console.log" append="off"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </serial>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <video>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </video>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </rng>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:   </devices>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]: </domain>
May 26 04:57:59.240963 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:57:59.242864 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Preparing to wait for external event network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:57:59.242864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:57:59.242864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:57:59.242864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:57:59.244193 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945830772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945830772',id=2,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-3p44ecdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:53Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=23a26816-a71d-42c9-8061-d464d5058a92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:57:59.244412 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:57:59.245338 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:57:59.245619 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:57:59.246019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.247296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:57:59.247296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:57:59.248417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.248417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b642ae3c-f444-51ee-b464-6e5f7794c077', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:57:59.252514 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.252514 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:57:59.253755 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:57:59.415306 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 26 04:57:59.415461 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:57:59.415576 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:57:59.415639 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:59.415701 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:57:59.415802 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:57:59.415851 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:57:59.415890 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:59.415930 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 26 04:57:59.615677 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:57:59.797427 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 26 04:57:59.797508 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:57:59.797577 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:57:59.797631 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:59.797665 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:57:59.797694 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:57:59.797767 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:57:59.797815 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:57:59.797815 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 26 04:57:59.854686 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:59.870658 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:57:59.880341 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:00.059304 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updated VIF entry in instance network info cache for port 26ab0a2f-caaf-46e0-b94d-c475f871c790. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:00.060771 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updating instance_info_cache with network_info: [{"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:00.084945 np0000001388 sudo[109672]: pam_unix(sudo:session): session closed for user root
May 26 04:58:00.086459 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Spawned new privsep daemon via rootwrap
May 26 04:58:00.087324 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon starting
May 26 04:58:00.087478 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
May 26 04:58:00.087516 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
May 26 04:58:00.087599 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 109696
May 26 04:58:00.089987 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Updated VIF entry in instance network info cache for port c81ef482-06df-40d2-b7a8-f9579f4420e4. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:00.090470 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Updating instance_info_cache with network_info: [{"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:00.091757 np0000001388 nova-compute[98319]: WARNING oslo_privsep.priv_context [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] privsep daemon already running
May 26 04:58:00.120944 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:00.349121 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:00.349460 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26ab0a2f-ca, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.350004 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26ab0a2f-ca, col_values=(('qos', UUID('76cf83a8-2579-4c04-8ec4-17f0611b7944')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.350732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26ab0a2f-ca, col_values=(('external_ids', {'iface-id': '26ab0a2f-caaf-46e0-b94d-c475f871c790', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:78:67', 'vm-uuid': '8a4df71c-706b-4393-a8aa-fdffa726dbda'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.351651 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:00.353555 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:00.357951 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:00.358708 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:00.358928 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc81ef482-06, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.359272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc81ef482-06, col_values=(('qos', UUID('f24aa2c1-d32d-4ba4-a388-960de6d13435')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.359272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc81ef482-06, col_values=(('external_ids', {'iface-id': 'c81ef482-06df-40d2-b7a8-f9579f4420e4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:29:9f', 'vm-uuid': '23a26816-a71d-42c9-8061-d464d5058a92'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:00.360609 np0000001388 nova-compute[98319]: INFO os_vif [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca')
May 26 04:58:00.362136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:00.369140 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:00.370177 np0000001388 nova-compute[98319]: INFO os_vif [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06')
May 26 04:58:00.563763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ccfa150-575f-4f6c-b615-45df95a66c0b req-3ab09fc9-e42b-4a61-8dd5-298ef73b3152 service nova] Releasing lock "refresh_cache-8a4df71c-706b-4393-a8aa-fdffa726dbda" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:00.593600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Releasing lock "refresh_cache-23a26816-a71d-42c9-8061-d464d5058a92" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:00.593971 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:00.594039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:00.594210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:00.594379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:00.594505 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] No event matching network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 in dict_keys([('network-vif-plugged', '26ab0a2f-caaf-46e0-b94d-c475f871c790')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:58:00.594622 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received unexpected event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 for instance with vm_state building and task_state spawning.
May 26 04:58:00.594736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received event network-vif-unplugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:00.594856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:00.595075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:00.595075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:00.595170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] No event matching network-vif-unplugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 in dict_keys([('network-vif-plugged', 'c81ef482-06df-40d2-b7a8-f9579f4420e4')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:58:00.595414 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6b9d505d-bcfc-438c-9a1c-718fea0620e5 req-cf7ffb8d-46fe-49d4-bf46-c6d19b345d40 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received unexpected event network-vif-unplugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 for instance with vm_state building and task_state spawning.
May 26 04:58:00.623699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:00.624224 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance network_info: |[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:00.625041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:00.626316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start _get_guest_xml network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:00.626635 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Refreshing network info cache for port a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:00.629297 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:00.630511 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1700156257', uuid='8d835b9c-8a58-4b53-9235-c49e96173d32'), owner=OwnerMeta(userid='e403f092f91b47c1b1e6664b4f806bd2', username='tempest-ServerActionsTestOtherB-517547792-project-member', projectid='3e44351e7dfd4870bf0073b5f95c0423', projectname='tempest-ServerActionsTestOtherB-517547792'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771480.6301596) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:00.631387 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:00.631722 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:00.632627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:00.632781 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:00.633537 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:00.633891 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:00.634078 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:00.634322 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:00.634479 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:00.634584 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:00.634740 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:00.634929 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:00.635078 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:00.635248 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:00.635419 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:00.635588 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:00.650945 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:00.651169 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:00.651685 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:00.652280 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:01.129065 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:01.132796 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.154896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <uuid>8d835b9c-8a58-4b53-9235-c49e96173d32</uuid>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <name>instance-00000003</name>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-1700156257</nova:name>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:00</nova:creationTime>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:user uuid="e403f092f91b47c1b1e6664b4f806bd2">tempest-ServerActionsTestOtherB-517547792-project-member</nova:user>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:project uuid="3e44351e7dfd4870bf0073b5f95c0423">tempest-ServerActionsTestOtherB-517547792</nova:project>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         <nova:port uuid="a1df6515-d249-4964-8dc0-e810a2fa8446">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="serial">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="uuid">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:31:f0:b0"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <target dev="tapa1df6515-d2"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/console.log" append="off"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:01.154896 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:01.157380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Preparing to wait for external event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:01.157380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:01.157380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:01.157380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:01.157380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:57:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:01.158556 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:01.158556 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:01.158556 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:01.158556 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.158878 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:01.159023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:01.159788 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.159900 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a69b89bf-87f7-54f0-b3ec-5b7d0d7e0e02', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:01.162646 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.163285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:01.172021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.174996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.174996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1df6515-d2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:01.175712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1df6515-d2, col_values=(('qos', UUID('55c48519-5cb6-41c9-87a1-1a84698b4398')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:01.175712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1df6515-d2, col_values=(('external_ids', {'iface-id': 'a1df6515-d249-4964-8dc0-e810a2fa8446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f0:b0', 'vm-uuid': '8d835b9c-8a58-4b53-9235-c49e96173d32'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:01.176498 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.177730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:01.189226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.189965 np0000001388 nova-compute[98319]: INFO os_vif [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 04:58:01.489450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:01.493332 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:01.726021 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updated VIF entry in instance network info cache for port a1df6515-d249-4964-8dc0-e810a2fa8446. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:01.726405 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:01.880062 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:01.880375 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:01.881231 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No VIF found with MAC fa:16:3e:17:78:67, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:01.881231 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Using config drive
May 26 04:58:01.888994 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:01.889174 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:01.889174 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:17:29:9f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:01.889999 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Using config drive
May 26 04:58:02.022774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:02.022774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:02.228109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-035c8de5-4ce4-44c3-af86-7f934249e5fd req-396e95dd-3afe-4da4-a616-faecc1dbaf98 service nova] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:02.387021 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:02.394241 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:02.524399 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:02.707288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:02.707417 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:02.707559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No VIF found with MAC fa:16:3e:31:f0:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:02.707909 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Using config drive
May 26 04:58:02.872224 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Creating config drive at /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.config
May 26 04:58:02.876385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuca1u9_b {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:02.897577 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Creating config drive at /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.config
May 26 04:58:02.902702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu4zh58nb {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:02.911855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuca1u9_b" returned: 0 in 0.035s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:02.936032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpu4zh58nb" returned: 0 in 0.033s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:03.097713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:03.097943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:03.100650 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:03.100751 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Claim successful on node np0000001388
May 26 04:58:03.216049 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:03.478498 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:03.500272 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Creating config drive at /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config
May 26 04:58:03.510398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9gi2kak {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:03.552978 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_9gi2kak" returned: 0 in 0.042s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:03.835564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:03.861352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:03.862480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.054570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.079649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.109620 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7423b373-71d1-40b5-8079-5365922cf15c req-d44ebdcd-7aa7-432f-880f-87407bdace4e service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:04.109620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7423b373-71d1-40b5-8079-5365922cf15c req-d44ebdcd-7aa7-432f-880f-87407bdace4e service nova] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:04.110664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7423b373-71d1-40b5-8079-5365922cf15c req-d44ebdcd-7aa7-432f-880f-87407bdace4e service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:04.110664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7423b373-71d1-40b5-8079-5365922cf15c req-d44ebdcd-7aa7-432f-880f-87407bdace4e service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:04.110664 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7423b373-71d1-40b5-8079-5365922cf15c req-d44ebdcd-7aa7-432f-880f-87407bdace4e service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Processing event network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:04.317598 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.341867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.426745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.432837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.451179 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:04.453574 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:04.463057 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.567245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.688746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:04.963710 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:05.259385 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:05.260693 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779771485.26045, 8a4df71c-706b-4393-a8aa-fdffa726dbda => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:05.260926 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] VM Started (Lifecycle Event)
May 26 04:58:05.270927 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:05.274187 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Instance spawned successfully.
May 26 04:58:05.274616 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:05.475022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.377s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:05.476714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:05.766468 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:05.769635 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:05.785895 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.786127 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.786610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.786968 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.787351 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.787709 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:05.984049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:05.984514 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:05.986745 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:05.986745 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:06.098842 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1b2f1c00cd8407db8523182fc86aa68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05f3a65784ad474cbbbf803346ae848c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:06.107251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:06.107251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:06.175941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:06.177573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:06.177936 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:06.201723 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:06.202356 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:06.202622 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:06.202761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:06.202869 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] No waiting events found dispatching network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:06.203010 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received unexpected event network-vif-plugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 for instance with vm_state building and task_state spawning.
May 26 04:58:06.203141 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received event network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:06.204315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:06.204531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:06.204701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:06.204871 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Processing event network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:06.205058 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received event network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:06.205430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:06.205929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:06.206016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:06.206548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:06.206701 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] No waiting events found dispatching network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:06.206844 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6ab84481-2e89-461b-9bfe-6037c25d20dd req-8c615f6d-ba40-4fc6-8378-3ab47bb70dc7 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received unexpected event network-vif-plugged-c81ef482-06df-40d2-b7a8-f9579f4420e4 for instance with vm_state building and task_state spawning.
May 26 04:58:06.209296 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:06.210697 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Instance spawned successfully.
May 26 04:58:06.212126 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:06.274923 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:06.275224 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771486.274985, 8a4df71c-706b-4393-a8aa-fdffa726dbda => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:06.275444 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] VM Paused (Lifecycle Event)
May 26 04:58:06.293701 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Took 14.39 seconds to spawn the instance on the hypervisor.
May 26 04:58:06.293701 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:06.489603 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:06.492635 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:06.607178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:06.609056 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:06.678158 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:06.726833 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.727241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.727481 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.727786 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.728135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.728429 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:06.779403 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:06.781549 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771486.7811258, 8a4df71c-706b-4393-a8aa-fdffa726dbda => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:06.781737 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] VM Resumed (Lifecycle Event)
May 26 04:58:06.789673 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Successfully created port: 9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:06.803639 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Took 19.71 seconds to build instance.
May 26 04:58:06.993314 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:07.024620 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.026389 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.029405 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.043892 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.168423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:07.168583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:07.173533 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:07.173660 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Claim successful on node np0000001388
May 26 04:58:07.235312 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Took 13.18 seconds to spawn the instance on the hypervisor.
May 26 04:58:07.235431 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:07.242478 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:07.284444 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:07.288187 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:07.310276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d2487347-4605-4e65-8f61-7484067fccc8 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.220s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:07.504633 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Successfully updated port: 9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:07.624677 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-changed-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:07.626381 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Refreshing instance network info cache due to event network-changed-9f87b34a-27db-4487-be94-b68c78061b43. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:07.626381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] Acquiring lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:07.626381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] Acquired lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:07.626381 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Refreshing network info cache for port 9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:07.748962 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Took 20.63 seconds to build instance.
May 26 04:58:07.791677 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771487.791129, 23a26816-a71d-42c9-8061-d464d5058a92 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:07.791677 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] VM Started (Lifecycle Event)
May 26 04:58:07.937115 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.938758 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:07.958960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:08.007867 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:08.008719 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:08.008957 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Creating image(s)
May 26 04:58:08.009431 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:08.009558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:08.010004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:08.010633 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:08.013072 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:08.014129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:08.023640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:08.083932 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:08.084450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:08.084973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:08.085537 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:08.088262 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:08.088688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:08.129902 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:08.174085 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:08.175817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:08.222848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk 1073741824" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:08.223436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:08.223731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:08.250020 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:08.254502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-331d679f-f025-4652-8ba0-b977c098e5f7 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:08.295310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:08.301142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:08.310701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:08.310701 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:58:08.310961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:08.408982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:08.409568 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Cannot resize image /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:58:08.410472 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:58:08.410472 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Ensure instance console log exists: /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:08.410670 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:08.410972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:08.411117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:08.431116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:08.436681 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:08.436855 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:08.463029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:08.546112 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:08.663381 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:08.663626 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:08.807946 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771488.807656, 23a26816-a71d-42c9-8061-d464d5058a92 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:08.809298 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] VM Paused (Lifecycle Event)
May 26 04:58:09.049473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f530024-0bff-4edf-b95d-940ca4770823 req-36676755-a327-48a9-8573-b012925152af service nova] Releasing lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:09.050131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquired lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:09.050131 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:09.086332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:09.086332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:09.166074 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:09.312263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:09.313717 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771489.3135056, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:09.313848 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Started (Lifecycle Event)
May 26 04:58:09.362599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:09.591956 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lazy-loading 'flavor' on Instance uuid 8a4df71c-706b-4393-a8aa-fdffa726dbda {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:09.634835 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:09.672523 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.504s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:09.675217 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:09.676241 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.434s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:09.678990 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:09.679623 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Claim successful on node np0000001388
May 26 04:58:09.821290 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:09.825300 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:09.827306 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771489.8271048, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:09.828370 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Paused (Lifecycle Event)
May 26 04:58:10.093882 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating instance_info_cache with network_info: [{"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:10.180587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:10.180751 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:10.181027 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:10.182719 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:10.330367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:10.332131 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:10.351566 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3630ce8e1080445181b66720eb588b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6324f4c1c47a4936ba1ff72bba1fe12b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:10.597875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Releasing lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:10.597875 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance network_info: |[{"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:10.601617 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Start _get_guest_xml network_info=[{"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:10.603205 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.517s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:10.609121 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:10.611978 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-276036843', uuid='ffc28a48-a02b-4225-9a27-6c0b4f33101c'), owner=OwnerMeta(userid='b1b2f1c00cd8407db8523182fc86aa68', username='tempest-VolumesAssistedSnapshotsTest-899536495-project-member', projectid='05f3a65784ad474cbbbf803346ae848c', projectname='tempest-VolumesAssistedSnapshotsTest-899536495'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771490.6103451) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:10.614096 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:10.614913 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:10.616159 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:10.616567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:10.617970 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:10.618444 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:10.619164 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:10.619382 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:10.619801 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:10.619951 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:10.620104 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:10.620348 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:10.620932 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:10.621112 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:10.621310 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:10.621491 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:10.634338 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-276036843',display_name='tempest-VolumesAssistedSnapshotsTest-server-276036843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesassistedsnapshotstest-server-276036843',id=4,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5n4PWmJlNOusskWP6zjb0sRw29wLNUVZdIGtGrCiNlhBWGEB5iPXMYL/ZPBny4hR8bOWLBFn1PEjw6T3uuRx6a/jdmOWXLrsz+lCdZDxcF5ohjHncom0pQi0ItN+tICA==',key_name='tempest-keypair-1031968398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f3a65784ad474cbbbf803346ae848c',ramdisk_id='',reservation_id='r-66dsq433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-899536495',owner_user_name='tempest-VolumesAssistedSnapshotsTest-899536495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b2f1c00cd8407db8523182fc86aa68',uuid=ffc28a48-a02b-4225-9a27-6c0b4f33101c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:10.634536 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converting VIF {"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:10.635657 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:10.636462 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lazy-loading 'pci_devices' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:10.685138 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:10.837807 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:10.838292 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771490.8379517, 23a26816-a71d-42c9-8061-d464d5058a92 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:10.839190 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] VM Resumed (Lifecycle Event)
May 26 04:58:10.933030 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:11.019467 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Successfully created port: 4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:11.637404 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <uuid>ffc28a48-a02b-4225-9a27-6c0b4f33101c</uuid>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <name>instance-00000004</name>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-276036843</nova:name>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:10</nova:creationTime>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:user uuid="b1b2f1c00cd8407db8523182fc86aa68">tempest-VolumesAssistedSnapshotsTest-899536495-project-member</nova:user>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:project uuid="05f3a65784ad474cbbbf803346ae848c">tempest-VolumesAssistedSnapshotsTest-899536495</nova:project>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         <nova:port uuid="9f87b34a-27db-4487-be94-b68c78061b43">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="serial">ffc28a48-a02b-4225-9a27-6c0b4f33101c</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="uuid">ffc28a48-a02b-4225-9a27-6c0b4f33101c</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.config"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:83:c2:ac"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <target dev="tap9f87b34a-27"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/console.log" append="off"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:11.637404 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:11.637404 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Preparing to wait for external event network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:11.637404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:11.637404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:11.643018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:11.643018 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-276036843',display_name='tempest-VolumesAssistedSnapshotsTest-server-276036843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesassistedsnapshotstest-server-276036843',id=4,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5n4PWmJlNOusskWP6zjb0sRw29wLNUVZdIGtGrCiNlhBWGEB5iPXMYL/ZPBny4hR8bOWLBFn1PEjw6T3uuRx6a/jdmOWXLrsz+lCdZDxcF5ohjHncom0pQi0ItN+tICA==',key_name='tempest-keypair-1031968398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05f3a65784ad474cbbbf803346ae848c',ramdisk_id='',reservation_id='r-66dsq433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-899536495',owner_user_name='tempest-VolumesAssistedSnapshotsTest-899536495-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b2f1c00cd8407db8523182fc86aa68',uuid=ffc28a48-a02b-4225-9a27-6c0b4f33101c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:11.643018 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converting VIF {"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5463ead6-2c17-5fc0-9d76-ab68aa231893', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f87b34a-27, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f87b34a-27, col_values=(('qos', UUID('000934f7-7894-46c1-83fb-198ef74f919b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f87b34a-27, col_values=(('external_ids', {'iface-id': '9f87b34a-27db-4487-be94-b68c78061b43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:c2:ac', 'vm-uuid': 'ffc28a48-a02b-4225-9a27-6c0b4f33101c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: INFO os_vif [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27')
May 26 04:58:11.645263 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: image_snapshot, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] instance snapshotting
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:11.646750 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Beginning live snapshot process
May 26 04:58:11.664019 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Successfully updated port: 4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:11.687708 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:11.849449 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] During sync_power_state the instance has a pending task (image_snapshot). Skip.
May 26 04:58:11.953959 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:11.954125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:11.954312 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:11.954490 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:11.954663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No event matching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 in dict_keys([('network-vif-plugged', 'a1df6515-d249-4964-8dc0-e810a2fa8446')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:58:11.954792 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-524561ae-1cef-4348-b134-46bc6bb35587 req-8797f8c6-31df-484a-b982-8ad49ac300c1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state building and task_state spawning.
May 26 04:58:12.162453 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-changed-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:12.164049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Refreshing instance network info cache due to event network-changed-4b55beac-defe-45b7-8158-98dd534cbe0d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:12.164361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] Acquiring lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:12.164504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] Acquired lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:12.164720 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Refreshing network info cache for port 4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:12.167328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:12.204569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.526s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:12.204569 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:12.210825 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:12.211952 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:12.214223 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Creating image(s)
May 26 04:58:12.214223 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:12.214223 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:12.214992 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:12.215663 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:12.221376 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:12.223124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:12.281503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:12.281901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:12.282044 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Attaching volume 12b41108-b7dd-494a-a206-0e3281984ca7 to /dev/vdb
May 26 04:58:12.312633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:12.313112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:12.313462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:12.314624 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:12.318070 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:12.318434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:12.380831 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:12.381710 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpt4w1swrh/privsep.sock']
May 26 04:58:12.391909 np0000001388 sudo[110476]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpt4w1swrh/privsep.sock
May 26 04:58:12.393362 np0000001388 sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002)
May 26 04:58:12.400800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:12.401296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:12.436022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk 1073741824" returned: 0 in 0.034s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:12.436789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.123s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:12.436987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:12.522487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:12.522952 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:58:12.523235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:12.595998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:12.607613 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Cannot resize image /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:58:12.608291 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:58:12.608489 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Ensure instance console log exists: /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:12.609213 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:12.609820 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:12.610218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:12.667221 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:12.685503 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning:
May 26 04:58:12.685619 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:58:12.686064 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet.patcher
May 26 04:58:12.709464 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:12.709587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:12.709678 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] No VIF found with MAC fa:16:3e:83:c2:ac, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:12.710137 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Using config drive
May 26 04:58:12.716553 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:12.717030 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:12.718273 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:12.718273 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:12.787898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:12.827385 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3630ce8e1080445181b66720eb588b87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6324f4c1c47a4936ba1ff72bba1fe12b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:13.039791 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:13.074944 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning:
May 26 04:58:13.075028 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
May 26 04:58:13.075097 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
May 26 04:58:13.075169 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:58:13.075253 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
May 26 04:58:13.075327 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
May 26 04:58:13.075392 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
May 26 04:58:13.075462 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log: 
May 26 04:58:13.075539 np0000001388 nova-compute[98319]: WARNING oslo.privsep.daemon [-] privsep log:   __import__(import_str)
May 26 04:58:13.116239 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.189553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json -f qcow2" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:13.190144 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.224798 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:13.225316 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:13.294538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:13.296823 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:13.300908 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:13.301473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.367895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:13.368945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.401084 np0000001388 sudo[110476]: pam_unix(sudo:session): session closed for user root
May 26 04:58:13.403346 np0000001388 nova-compute[98319]: INFO oslo.privsep.daemon [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Spawned new privsep daemon via rootwrap
May 26 04:58:13.419909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6.delta 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:13.421346 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Quiescing instance not available: QEMU guest agent is not enabled.
May 26 04:58:13.497421 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Creating config drive at /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.config
May 26 04:58:13.505475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsgll47ng {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.524851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:13.526054 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.nvmeof [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
May 26 04:58:13.542417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b911b5c6-7099-455e-8a4d-208fee40878f req-f54f0c5d-5288-419a-b621-636d86a19bba service nova] Releasing lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:13.543886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquired lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:13.544397 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:13.548178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsgll47ng" returned: 0 in 0.042s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:13.562255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:13.585255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:13.587410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:13.599566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:13.601824 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:7867', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::1c27:aff:fe7f:7cb7', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e'] 
May 26 04:58:13.601824 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:13.602085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:13.602660 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] <== get_connector_properties: return (1221ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:13.602660 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updating existing volume attachment record: 9003c4d9-b0cf-4862-92f7-1f565268fc81 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:13.737537 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:13.739995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 04:58:13.743492 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Skipping quiescing instance: QEMU guest agent is not enabled.
May 26 04:58:14.041601 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Successfully created port: 25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:14.048316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:14.048882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.048882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.049012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:14.052296 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Processing event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:14.052296 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:14.052365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.052684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.052754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:14.052867 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:14.053087 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d362fb6c-3e24-4b54-a769-5c18aaf3e2d7 req-b2fde070-c01f-4232-a96c-22c9d810ac2b service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state building and task_state spawning.
May 26 04:58:14.058318 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance event wait completed in 8 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:14.063954 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771494.0635304, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:14.068030 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Resumed (Lifecycle Event)
May 26 04:58:14.071969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:14.083387 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance spawned successfully.
May 26 04:58:14.084152 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:14.174907 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 04:58:14.175771 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6.delta /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:14.199093 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:14.216327 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.216327 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.217535 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connector [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Factory for ISCSI on None {{(pid=98319) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}}
May 26 04:58:14.217815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:14.218141 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:14.219013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:14.219368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:14.220006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:14.220897 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:58:14.241422 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:14.249512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:14.250754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:14.251017 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:14.251277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:14.251454 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:14.269910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:14.269910 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:14.271270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:14.271270 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:14.298521 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7] added
May 26 04:58:14.298521 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298521 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:14.298521 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298521 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298521 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:14.298521 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:14.298750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7] added
May 26 04:58:14.298750 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298750 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:14.298750 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298750 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:14.298750 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:14.298750 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:14.298993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:14.299167 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.048(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:14.299291 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:14.299388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:14.300267 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0482(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:14.300726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.302385 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:14.321734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.333604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6.delta /opt/stack/data/nova/instances/snapshots/tmpfkwywl9q/a25a5a32526c4247a42999ecc1233fb6" returned: 0 in 0.157s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:14.333604 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Snapshot extracted, beginning image upload
May 26 04:58:14.474295 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.504395 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:14.572122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:14.576268 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:14.594418 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.594855 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.594964 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.595122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.595428 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.595657 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:14.725534 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3398919-f924-4ed9-9dcd-0e3c9118c49a req-6655e06e-738d-407c-a9b2-7f61db973d7b service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:14.726245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3398919-f924-4ed9-9dcd-0e3c9118c49a req-6655e06e-738d-407c-a9b2-7f61db973d7b service nova] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.726245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3398919-f924-4ed9-9dcd-0e3c9118c49a req-6655e06e-738d-407c-a9b2-7f61db973d7b service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.726245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3398919-f924-4ed9-9dcd-0e3c9118c49a req-6655e06e-738d-407c-a9b2-7f61db973d7b service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:14.726245 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3398919-f924-4ed9-9dcd-0e3c9118c49a req-6655e06e-738d-407c-a9b2-7f61db973d7b service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Processing event network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:14.731599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.739579 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.740673 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.749021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:14.751375 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:14.751375 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Creating image(s)
May 26 04:58:14.756988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.757717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.758342 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:14.762410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:14.764085 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:14.769472 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:14.772373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:14.885776 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:14.888536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:14.888536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:14.889309 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:14.895294 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:14.895294 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:14.985345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:14.985345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:15.022112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk 1073741824" returned: 0 in 0.037s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:15.022667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.135s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:15.023031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:15.082876 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updating instance_info_cache with network_info: [{"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:15.086006 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:15.107653 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Took 17.07 seconds to spawn the instance on the hypervisor.
May 26 04:58:15.107913 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:15.142067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:15.143533 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Checking if we can resize image /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:58:15.144257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Cannot resize image /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Ensure instance console log exists: /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:15.240651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:15.301143 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:15.303258 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:15.322035 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:15.322035 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.329584 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Successfully updated port: 25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:15.335165 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:15.335165 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.342253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.357370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.367677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:15.367677 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:15.371272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:15.371272 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:15.371272 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 04:58:15.371272 np0000001388 nova-compute[98319]: 
May 26 04:58:15.376668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:15.376668 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:15.377081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:15.377081 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:15.377366 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 04:58:15.377366 np0000001388 nova-compute[98319]: 
May 26 04:58:15.397771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.40.100,3260]
May 26 04:58:15.397771 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.40.100,3260] successful.
May 26 04:58:15.397771 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.415781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.50.100,3260]
May 26 04:58:15.415781 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.50.100,3260] successful.
May 26 04:58:15.415781 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.420050 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.439752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:15.453003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.453003 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.453003 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:15.453003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.453003 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.453003 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:15.454340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:15.454733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:15.456428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.456428 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.456428 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:15.456610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.456610 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:15.456610 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:15.456889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:15.457069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:15.459209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] HCTL ('7', '-', '-', 0) found on session 3 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:15.459209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:15.459762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] HCTL ('8', '-', '-', 0) found on session 4 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:15.460394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:15.486860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:15.514886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:15.514886 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771495.5113232, ffc28a48-a02b-4225-9a27-6c0b4f33101c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:15.514886 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] VM Started (Lifecycle Event)
May 26 04:58:15.520294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Searching for a device in session 4 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:15.520294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:15.522077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:15.530035 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance spawned successfully.
May 26 04:58:15.531742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:15.592758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Releasing lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:15.592758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance network_info: |[{"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:15.603917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Start _get_guest_xml network_info=[{"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:15.615740 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:15.620274 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1461376653-1', uuid='7e0085ac-d343-4e32-85db-8489cbf3a677'), owner=OwnerMeta(userid='3630ce8e1080445181b66720eb588b87', username='tempest-TestMultiAttachVolumeSwap-1732757564-project-member', projectid='6324f4c1c47a4936ba1ff72bba1fe12b', projectname='tempest-TestMultiAttachVolumeSwap-1732757564'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771495.6196454) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:15.629414 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:15.629414 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:15.630833 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Took 22.60 seconds to build instance.
May 26 04:58:15.641392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:15.643009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:15.644260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:15.645711 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:15.646018 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:15.646018 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:15.646265 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:15.646349 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:15.646534 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:15.647644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:15.647644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:15.647644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:15.647644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:15.647644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:15.679592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-1',id=5,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=7e0085ac-d343-4e32-85db-8489cbf3a677,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:15.679846 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:15.681740 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:15.682513 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:15.836986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:15.837108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquired lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:15.837300 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:16.014828 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:16.017216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:16.038235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.038694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.039037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.039332 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.039583 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.039828 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:16.147212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5db2cd7a-de18-4cd3-b66c-d2f9ca09b8a5 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:16.158399 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.192943 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <uuid>7e0085ac-d343-4e32-85db-8489cbf3a677</uuid>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <name>instance-00000005</name>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1461376653-1</nova:name>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:15</nova:creationTime>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:user uuid="3630ce8e1080445181b66720eb588b87">tempest-TestMultiAttachVolumeSwap-1732757564-project-member</nova:user>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:project uuid="6324f4c1c47a4936ba1ff72bba1fe12b">tempest-TestMultiAttachVolumeSwap-1732757564</nova:project>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         <nova:port uuid="4b55beac-defe-45b7-8158-98dd534cbe0d">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="serial">7e0085ac-d343-4e32-85db-8489cbf3a677</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="uuid">7e0085ac-d343-4e32-85db-8489cbf3a677</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.config"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:5f:78:a1"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <target dev="tap4b55beac-de"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/console.log" append="off"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:16.192943 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:16.195486 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Preparing to wait for external event network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:16.195486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:16.195486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:16.195486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:16.195486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-1',id=5,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=7e0085ac-d343-4e32-85db-8489cbf3a677,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:16.195767 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:16.195767 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:16.195767 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:16.196387 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.197227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:16.197227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:16.199395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.199633 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f2fced5-b7b4-57b2-9959-aaee4b00a6c8', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:16.201162 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.201274 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:16.202548 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.204095 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.204263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b55beac-de, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:16.204595 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b55beac-de, col_values=(('qos', UUID('2ec54ef7-bd4d-4564-ae2a-2a7638d8b257')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:16.204776 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b55beac-de, col_values=(('external_ids', {'iface-id': '4b55beac-defe-45b7-8158-98dd534cbe0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:78:a1', 'vm-uuid': '7e0085ac-d343-4e32-85db-8489cbf3a677'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:16.205624 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.206976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:16.215092 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.215939 np0000001388 nova-compute[98319]: INFO os_vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de')
May 26 04:58:16.424648 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:16.491225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Searching for a device in session 3 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:16.491225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:16.495668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:16.521036 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:16.521390 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771496.5210536, ffc28a48-a02b-4225-9a27-6c0b4f33101c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:16.521581 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] VM Paused (Lifecycle Event)
May 26 04:58:16.545724 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Took 8.54 seconds to spawn the instance on the hypervisor.
May 26 04:58:16.545724 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:16.673293 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:16.842426 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:16.842779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:16.842884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:16.843105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:16.843265 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] No waiting events found dispatching network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:16.843447 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received unexpected event network-vif-plugged-9f87b34a-27db-4487-be94-b68c78061b43 for instance with vm_state active and task_state None.
May 26 04:58:16.844217 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:16.844358 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing instance network info cache due to event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:16.844972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Acquiring lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:16.890900 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:17.024825 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:17.029286 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771497.027797, ffc28a48-a02b-4225-9a27-6c0b4f33101c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:17.029286 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] VM Resumed (Lifecycle Event)
May 26 04:58:17.055913 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Took 14.03 seconds to build instance.
May 26 04:58:17.267936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Found WWN 330000000c1c12e42 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:58:17.269139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:17.269139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000c1c12e42', 'path': '/dev/dm-0', 'multipath_id': '330000000c1c12e42'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:17.269139 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c1c12e42', 'path': '/dev/dm-0', 'multipath_id': '330000000c1c12e42'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:58:17.272872 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lazy-loading 'flavor' on Instance uuid 8a4df71c-706b-4393-a8aa-fdffa726dbda {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:17.396650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Releasing lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:17.396856 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Instance network_info: |[{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:17.397754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Acquired lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:17.400071 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:17.401108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Start _get_guest_xml network_info=[{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:17.407879 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:17.409232 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-1461376653-2', uuid='595593d5-7b8b-4177-a99e-d29c31010070'), owner=OwnerMeta(userid='3630ce8e1080445181b66720eb588b87', username='tempest-TestMultiAttachVolumeSwap-1732757564-project-member', projectid='6324f4c1c47a4936ba1ff72bba1fe12b', projectname='tempest-TestMultiAttachVolumeSwap-1732757564'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771497.4087543) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:17.411674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:17.412283 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:17.414381 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:17.414539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:17.415430 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:17.416431 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:17.416721 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:17.417045 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:17.417220 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:17.417388 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:17.417545 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:17.417766 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:17.417910 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:17.418420 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:17.418628 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:17.418801 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:17.436428 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-2',id=6,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=595593d5-7b8b-4177-a99e-d29c31010070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:17.436847 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:17.437406 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:17.438001 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'pci_devices' on Instance uuid 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:17.531773 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:17.533507 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:17.558642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-38400338-6708-4a67-be6c-289e7e68eb24 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.535s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:17.739031 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:17.739282 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:17.739405 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No VIF found with MAC fa:16:3e:5f:78:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:17.739861 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Using config drive
May 26 04:58:17.776549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Attempting to attach volume 12b41108-b7dd-494a-a206-0e3281984ca7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 04:58:17.783380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] attach device xml: <disk type="block" device="disk">
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:   <alias name="ua-12b41108-b7dd-494a-a206-0e3281984ca7"/>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:   <serial>12b41108-b7dd-494a-a206-0e3281984ca7</serial>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]: </disk>
May 26 04:58:17.783380 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 04:58:17.903115 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:17.941368 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <uuid>595593d5-7b8b-4177-a99e-d29c31010070</uuid>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <name>instance-00000006</name>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestMultiAttachVolumeSwap-server-1461376653-2</nova:name>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:17</nova:creationTime>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:user uuid="3630ce8e1080445181b66720eb588b87">tempest-TestMultiAttachVolumeSwap-1732757564-project-member</nova:user>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:project uuid="6324f4c1c47a4936ba1ff72bba1fe12b">tempest-TestMultiAttachVolumeSwap-1732757564</nova:project>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         <nova:port uuid="25738872-72e4-45c4-a2e9-343e565dcf1b">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="serial">595593d5-7b8b-4177-a99e-d29c31010070</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="uuid">595593d5-7b8b-4177-a99e-d29c31010070</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.config"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:27:0c:d3"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <target dev="tap25738872-72"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/console.log" append="off"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:17.941368 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:17.943185 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Preparing to wait for external event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:17.943185 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:17.943185 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:17.943185 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:17.943185 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-2',id=6,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=595593d5-7b8b-4177-a99e-d29c31010070,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:17.943479 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:17.945404 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:17.945404 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:17.945565 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.945745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:17.945951 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:17.949859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.949859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ff054dc-54a6-5780-aa73-8244976673cc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:17.951170 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:17.957924 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.970875 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.971250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25738872-72, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:17.971470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25738872-72, col_values=(('qos', UUID('34660f0e-8bf4-4d83-ade2-827a8637b4c7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:17.972839 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25738872-72, col_values=(('external_ids', {'iface-id': '25738872-72e4-45c4-a2e9-343e565dcf1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:0c:d3', 'vm-uuid': '595593d5-7b8b-4177-a99e-d29c31010070'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:17.974909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.978319 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:17.987047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:17.988271 np0000001388 nova-compute[98319]: INFO os_vif [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72')
May 26 04:58:18.230977 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Snapshot image upload complete
May 26 04:58:18.231871 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4aeed8cb-5a20-4ca6-b5a4-91e64f68a03c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Took 6.79 seconds to snapshot the instance on the hypervisor.
May 26 04:58:18.247360 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:18.261563 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:18.913642 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Creating config drive at /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.config
May 26 04:58:18.919001 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1x2aue3u {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:18.962225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1x2aue3u" returned: 0 in 0.043s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:18.989435 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-changed-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:18.989924 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Refreshing instance network info cache due to event network-changed-a1df6515-d249-4964-8dc0-e810a2fa8446. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:18.990215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:18.990385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:18.991747 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Refreshing network info cache for port a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:19.325061 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-changed-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:19.325061 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Refreshing instance network info cache due to event network-changed-9f87b34a-27db-4487-be94-b68c78061b43. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:19.325061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] Acquiring lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:19.325245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] Acquired lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:19.325245 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Refreshing network info cache for port 9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:19.400053 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:19.497503 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:19.518085 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:19.520614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:19.520614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No VIF found with MAC fa:16:3e:27:0c:d3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:19.520614 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Using config drive
May 26 04:58:19.537698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:19.537955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:19.538038 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:19.538189 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] No VIF found with MAC fa:16:3e:17:78:67, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:19.555315 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:19.590272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:19.696222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:19.732075 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updated VIF entry in instance network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:19.732800 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:19.832233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:20.030513 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:20.102580 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.112792 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.119648 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.155283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.160142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.243449 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a0aff02e-efe8-408c-8958-c7f34d92ad3c req-dce2024a-8fee-411d-ae47-2b60accb50ec service nova] Releasing lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:20.521749 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:20.593782 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:20.614672 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Creating config drive at /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.config
May 26 04:58:20.623589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwybnotgu {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:20.676218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwybnotgu" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:20.792733 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.793720 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.793720 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.793720 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.794036 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.794240 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.795736 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.795736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 04:58:20.795996 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:58:20.816651 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771500.8156633, 7e0085ac-d343-4e32-85db-8489cbf3a677 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:20.817317 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] VM Started (Lifecycle Event)
May 26 04:58:20.887942 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updated VIF entry in instance network info cache for port a1df6515-d249-4964-8dc0-e810a2fa8446. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:20.888921 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:21.137988 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5f0bb4b0-f861-4366-b65a-98018f0109e6 req-b0b2e200-b68e-4522-970f-2701409e086e service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:21.138448 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f0bb4b0-f861-4366-b65a-98018f0109e6 req-b0b2e200-b68e-4522-970f-2701409e086e service nova] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:21.140331 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f0bb4b0-f861-4366-b65a-98018f0109e6 req-b0b2e200-b68e-4522-970f-2701409e086e service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:21.140709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f0bb4b0-f861-4366-b65a-98018f0109e6 req-b0b2e200-b68e-4522-970f-2701409e086e service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:21.141481 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5f0bb4b0-f861-4366-b65a-98018f0109e6 req-b0b2e200-b68e-4522-970f-2701409e086e service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Processing event network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:21.141906 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:21.154445 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:21.170437 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance spawned successfully.
May 26 04:58:21.172275 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:21.176757 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e38c7d4-34e5-4691-9e06-dc96f7727448 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.895s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:21.309909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:21.311262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:21.311262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:21.311262 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 04:58:21.322140 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:21.326872 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:21.336103 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:21.343223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:21.366340 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:21.393014 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-300f3555-2e7f-4241-aa1c-af607137e73a req-7b8fb268-745b-4a20-969c-2b0b4b6c6fba service nova] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:21.499402 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:21.559243 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:21.630614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:21.677897 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updated VIF entry in instance network info cache for port 9f87b34a-27db-4487-be94-b68c78061b43. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:21.678226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating instance_info_cache with network_info: [{"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:21.693801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.693801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.694124 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.694606 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.694986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.695839 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:21.831608 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:21.831933 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771501.8316987, 7e0085ac-d343-4e32-85db-8489cbf3a677 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:21.832041 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] VM Paused (Lifecycle Event)
May 26 04:58:22.186747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c16cce2-ef9b-4240-a9cd-352ae96bbdd6 req-966b61f7-ad77-4ed0-bff1-84115caedadd service nova] Releasing lock "refresh_cache-ffc28a48-a02b-4225-9a27-6c0b4f33101c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:22.203378 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Took 9.99 seconds to spawn the instance on the hypervisor.
May 26 04:58:22.203378 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:22.339258 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:22.345224 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771502.3448725, 7e0085ac-d343-4e32-85db-8489cbf3a677 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:22.345428 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] VM Resumed (Lifecycle Event)
May 26 04:58:22.409252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:22.409252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:22.409460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:22.409618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:22.409757 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:22.417889 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Terminating instance
May 26 04:58:22.723524 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Took 15.61 seconds to build instance.
May 26 04:58:22.731702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:22.840029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:22.840640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:22.855653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:22.862771 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:22.924737 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:58:22.950446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:22.960642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:22.967014 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:22.984005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:22.990572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:22.998841 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.002326 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.053518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.054357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.101214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:23.101866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:23.158824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.162973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.229334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.122s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:23.282029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:23.282029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:23.282029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:23.282029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:23.282029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] No waiting events found dispatching network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:23.283123 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received unexpected event network-vif-plugged-4b55beac-defe-45b7-8158-98dd534cbe0d for instance with vm_state active and task_state None.
May 26 04:58:23.285641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:23.288379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.289439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.309349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:23.310212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.022s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:23.312303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:23.312678 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] No waiting events found dispatching network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:23.313897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4bfb3613-5570-468f-93d2-53bb3ee21f70 req-d5262d7d-1d44-44f4-82bd-22caf9404217 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:58:23.323120 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Instance destroyed successfully.
May 26 04:58:23.324469 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lazy-loading 'resources' on Instance uuid 8a4df71c-706b-4393-a8aa-fdffa726dbda {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:23.367042 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771503.3662379, 595593d5-7b8b-4177-a99e-d29c31010070 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:23.367997 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] VM Started (Lifecycle Event)
May 26 04:58:23.410505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.414788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.497991 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.498893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.606540 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:23.615739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.616622 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:58:23.619715 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.704134 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.707275 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.779887 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.783127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.831529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1175059357',display_name='tempest-DeleteServersTestJSON-server-1175059357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-deleteserverstestjson-server-1175059357',id=1,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:06Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d18b0374cd494e1ba0a0dfbfa4ad5bfb',ramdisk_id='',reservation_id='r-fer10w6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-81488332',owner_user_name='tempest-DeleteServersTestJSON-81488332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:06Z,user_data=None,user_id='73836ad692a5416ba794954c66b65818',uuid=8a4df71c-706b-4393-a8aa-fdffa726dbda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:58:23.831529 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converting VIF {"id": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "address": "fa:16:3e:17:78:67", "network": {"id": "156257e2-b669-46f5-8baf-9454e4ad8775", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-563385530-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "d18b0374cd494e1ba0a0dfbfa4ad5bfb", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap26ab0a2f-ca", "ovs_interfaceid": "26ab0a2f-caaf-46e0-b94d-c475f871c790", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:23.833437 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:23.833990 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:58:23.838538 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.839354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26ab0a2f-ca, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:23.843416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.847134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:23.847424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.847659 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76cf83a8-2579-4c04-8ec4-17f0611b7944) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:23.849410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.849410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:23.851173 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:23.855789 np0000001388 nova-compute[98319]: INFO os_vif [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:78:67,bridge_name='br-int',has_traffic_filtering=True,id=26ab0a2f-caaf-46e0-b94d-c475f871c790,network=Network(156257e2-b669-46f5-8baf-9454e4ad8775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26ab0a2f-ca')
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12b41108-b7dd-494a-a206-0e3281984ca7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 04:58:23.858786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 04:58:23.872113 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:23.878225 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771503.8771608, 595593d5-7b8b-4177-a99e-d29c31010070 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:23.878225 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] VM Paused (Lifecycle Event)
May 26 04:58:23.881373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.882192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.893274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:23.893274 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:23.893274 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:23.893274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsi session list stdout=tcp: [3] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:23.893274 np0000001388 nova-compute[98319]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7 (non-flash)
May 26 04:58:23.893274 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:23.896278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', '4')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 04:58:23.897079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', '3')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:58:23.898757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7', '4')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:58:23.900313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46d8040>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 04:58:23.900766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 04:58:23.901363 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Flush multipath device 330000000c1c12e42 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 04:58:23.935285 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:58:23.966824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:23.969672 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:23.970772 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:23.981702 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:58:24.003730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.033s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:24.004444 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13858MB free_disk=74.74677658081055GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 04:58:24.004826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:24.006486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:24.042016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 04:58:24.042235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 04:58:24.043753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 04:58:24.059470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 04:58:24.059935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 04:58:24.079176 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.107226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.40.100,3260]
May 26 04:58:24.107226 np0000001388 nova-compute[98319]: Logout of [sid: 3, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.40.100,3260] successful.
May 26 04:58:24.107226 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.120771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.144261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.177250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.50.100,3260]
May 26 04:58:24.177250 np0000001388 nova-compute[98319]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-12b41108-b7dd-494a-a206-0e3281984ca7, portal: 192.168.50.100,3260] successful.
May 26 04:58:24.177250 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.193900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:24.193900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:24.193900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] <== disconnect_volume: return (336ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:24.193900 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 04:58:24.194572 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Deleting instance files /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda_del
May 26 04:58:24.195554 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Deletion of /opt/stack/data/nova/instances/8a4df71c-706b-4393-a8aa-fdffa726dbda_del complete
May 26 04:58:24.200569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:24.381826 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:24.383728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:24.706159 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Took 1.78 seconds to destroy the instance on the hypervisor.
May 26 04:58:24.706525 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:58:24.707185 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:58:24.707351 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:58:24.708219 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:24.816182 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:24.887232 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:24.887232 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999463404999915 future=<Future at 0x7d7ac4316d20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:24.887913 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99869954299993 future=<Future at 0x7d7ac4316d20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:24.888065 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998537037999995 future=<Future at 0x7d7ac4316d20 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:24.893788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:24.894093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:25.099180 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance ffc28a48-a02b-4225-9a27-6c0b4f33101c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:25.099535 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 8d835b9c-8a58-4b53-9235-c49e96173d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:25.099707 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 595593d5-7b8b-4177-a99e-d29c31010070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:25.099837 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7e0085ac-d343-4e32-85db-8489cbf3a677 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:25.100331 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 23a26816-a71d-42c9-8061-d464d5058a92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:25.289829 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8f85856c-e62c-4560-8d42-82ede5535487 req-96de1184-6482-414c-a491-648f436c4004 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-deleted-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:25.289996 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-8f85856c-e62c-4560-8d42-82ede5535487 req-96de1184-6482-414c-a491-648f436c4004 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Neutron deleted interface 26ab0a2f-caaf-46e0-b94d-c475f871c790; detaching it from the instance and deleting it from the info cache
May 26 04:58:25.290176 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8f85856c-e62c-4560-8d42-82ede5535487 req-96de1184-6482-414c-a491-648f436c4004 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:25.394084 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:25.394882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] Acquiring lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:25.395121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:25.396048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:25.396048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] No waiting events found dispatching network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:25.396048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed37c8a7-f6e5-419e-877c-2ea758ab8d8e req-ed160127-e9f3-4647-99cc-7eff0368370b service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Received event network-vif-unplugged-26ab0a2f-caaf-46e0-b94d-c475f871c790 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:58:25.396884 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:25.604171 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 255cce8a-f08d-4c8e-b498-4b0ef153fc5b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 04:58:25.720378 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:25.795893 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8f85856c-e62c-4560-8d42-82ede5535487 req-96de1184-6482-414c-a491-648f436c4004 service nova] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Detach interface failed, port_id=26ab0a2f-caaf-46e0-b94d-c475f871c790, reason: Instance 8a4df71c-706b-4393-a8aa-fdffa726dbda could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 04:58:25.970580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:25.979403 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:25.979634 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:26.107628 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 04:58:26.107838 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 8a4df71c-706b-4393-a8aa-fdffa726dbda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:58:26.108074 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 04:58:26.108266 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:58:24 up 30 min,  2 users,  load average: 6.82, 2.80, 1.31\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_deleting': '1', 'num_os_type_None': '6', 'num_proj_d18b0374cd494e1ba0a0dfbfa4ad5bfb': '1', 'io_workload': '1', 'num_task_None': '4', 'num_proj_89f7e0bdf71e47a9b6de4e03f880f492': '1', 'num_proj_3e44351e7dfd4870bf0073b5f95c0423': '1', 'num_proj_05f3a65784ad474cbbbf803346ae848c': '1', 'num_proj_6324f4c1c47a4936ba1ff72bba1fe12b': '2', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 04:58:26.222929 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Took 1.52 seconds to deallocate network for instance.
May 26 04:58:26.481806 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:26.506326 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:26.656632 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:26.656895 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:26.790232 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Took 0.57 seconds to detach 1 volumes for instance.
May 26 04:58:27.036056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:27.160383 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:27.217546 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba70ea5a-a5de-4e77-ad6f-1f7e4b0db131 req-2f4ab574-cdbe-4958-bdcb-3975a565f8ac service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:27.217758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba70ea5a-a5de-4e77-ad6f-1f7e4b0db131 req-2f4ab574-cdbe-4958-bdcb-3975a565f8ac service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:27.217934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba70ea5a-a5de-4e77-ad6f-1f7e4b0db131 req-2f4ab574-cdbe-4958-bdcb-3975a565f8ac service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:27.218099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba70ea5a-a5de-4e77-ad6f-1f7e4b0db131 req-2f4ab574-cdbe-4958-bdcb-3975a565f8ac service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:27.218255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba70ea5a-a5de-4e77-ad6f-1f7e4b0db131 req-2f4ab574-cdbe-4958-bdcb-3975a565f8ac service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Processing event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:27.221098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:27.223938 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:27.226173 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771507.2238088, 595593d5-7b8b-4177-a99e-d29c31010070 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:27.226395 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] VM Resumed (Lifecycle Event)
May 26 04:58:27.231059 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Instance spawned successfully.
May 26 04:58:27.231426 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:27.300683 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:27.666433 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 04:58:27.667120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.660s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:27.667528 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 58.71 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:58:27.668502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.468s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:27.671510 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:27.671643 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Claim successful on node np0000001388
May 26 04:58:27.729695 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:27.731411 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:27.739454 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:27.739603 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:27.740379 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:27.740379 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:27.740550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:27.740739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:28.234449 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:28.246183 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Took 13.50 seconds to spawn the instance on the hypervisor.
May 26 04:58:28.246424 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:28.770653 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Took 21.59 seconds to build instance.
May 26 04:58:28.850087 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:29.203728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:29.203995 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:29.270672 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9820608-54a9-4df0-8da5-888c20436fdd tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.094s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:29.297216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:29.297462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:29.297634 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:29.297714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:29.297858 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:29.297986 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a2a35940-736c-43b3-acc9-1014d5c36d83 req-b82ad42f-6197-41d3-8c66-5f40c59c3a38 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received unexpected event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with vm_state active and task_state None.
May 26 04:58:29.709622 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:30.219486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.551s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:30.221045 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.250s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:30.221340 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:30.226621 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:30.226621 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Claim successful on node np0000001388
May 26 04:58:30.394303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:30.394303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing instance network info cache due to event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:30.394303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] Acquiring lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:30.394468 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] Acquired lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:30.394752 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:30.734686 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:30.736015 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:30.736293 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:30.736501 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:30.817092 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d25c63261bb45f1bc8ab1e39768c377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f7e0bdf71e47a9b6de4e03f880f492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:30.896931 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:31.239002 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:31.290189 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Successfully created port: 0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:31.341919 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:31.503633 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:31.565863 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updated VIF entry in instance network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:31.566050 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:31.749794 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:31.910511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:31.910722 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:31.911890 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:32.025882 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Successfully updated port: 0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:32.068143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69bc08f-9241-4f73-9a43-1913aef364af req-2b518850-4d25-47bd-a6d1-fcc3561d5887 service nova] Releasing lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:32.078994 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-changed-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:32.078994 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Refreshing instance network info cache due to event network-changed-0afa9729-7742-4ca2-a601-24454af57a3c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:32.078994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] Acquiring lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:32.078994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] Acquired lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:32.078994 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Refreshing network info cache for port 0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:32.254728 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Booting with blank volume at /dev/vda
May 26 04:58:32.414687 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:32.528433 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:32.580650 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:32.651764 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:32.839141 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:32.925983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.706s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:32.926974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.891s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:32.927372 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:32.938271 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:32.941224 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Claim successful on node np0000001388
May 26 04:58:33.341923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb970e92-e57a-405d-bee9-2426cbccf8e5 req-4294babd-e5e6-425d-bb86-15691e3cd86e service nova] Releasing lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:33.342724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:33.342724 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:33.436161 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:33.436533 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:33.436936 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:33.437274 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:33.677617 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9381b603332a4888bbcde18a945c56a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a773253d42414a86a7ee9ed5a1939fdc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:33.852060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:33.919944 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:33.942827 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:34.165492 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:34.335699 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully created port: a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:34.516491 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:34.694252 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:34.694518 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:34.890072 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully created port: 43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:35.018896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:35.019133 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance network_info: |[{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:35.197080 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:35.404572 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully created port: 2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:35.457973 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:35.682512 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:35.696562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:35.707876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.781s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:35.707876 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:35.714101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 8.414s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:35.730122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:35.757274 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:35.759152 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3'] 
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:35.775220 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating existing volume attachment record: 5b56076b-e06a-4c16-bb7a-ef55a6355115 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:35.965561 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Booting with volume 9c8b09ab-5693-422c-93c6-0d2c6dbd3012 at /dev/vda
May 26 04:58:35.970191 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully created port: 30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:36.029153 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:36.045782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:36.069398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:36.095105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:36.095590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:36.111837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:36.113155 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3'] 
May 26 04:58:36.113311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:36.113450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:36.114540 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:36.114540 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating existing volume attachment record: f6fb0550-f685-4259-b863-1c040d1dd494 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:36.223069 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:36.223272 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:36.223645 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:36.223939 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:36.330211 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:36.330530 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:36.353357 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e78b48c4b4dc439086e392b4800b4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '278ea77812db4e90a14904f104739285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:36.507553 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:36.600127 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully created port: 203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:36.724888 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:36.835380 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:37.092974 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Successfully created port: daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:37.232025 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:37.281423 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:37.345686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.632s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:37.352125 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:37.352305 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-a7ef8ccb-c585-4d52-821d-9625a7566f42. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:37.352561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:37.352603 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:37.352708 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:37.412477 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Deleted allocations for instance 8a4df71c-706b-4393-a8aa-fdffa726dbda
May 26 04:58:37.679782 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Successfully updated port: daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:37.731879 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-changed-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:37.732322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing instance network info cache due to event network-changed-daeb843a-0159-409b-8390-b08c56ae2515. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:37.732322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] Acquiring lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:37.732322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] Acquired lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:37.732322 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing network info cache for port daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:37.747378 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Booting with volume f159b9f6-498a-4d19-a57a-adb7cf50d9e6 at /dev/vdb
May 26 04:58:37.803962 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:37.817160 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:37.841227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:37.859580 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:37.871664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:37.872660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:37.882412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:37.884657 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3'] 
May 26 04:58:37.884948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:37.885413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:37.885741 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:37.886105 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating existing volume attachment record: 49cfa873-672b-4583-98b6-0124899b5b0e {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:37.962021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:37.965007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:37.966695 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Creating image(s)
May 26 04:58:37.967279 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 04:58:37.967457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Ensure instance console log exists: /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:37.967747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:37.968027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:37.968245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:37.973586 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start _get_guest_xml network_info=[{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '5b56076b-e06a-4c16-bb7a-ef55a6355115', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '255cce8a-f08d-4c8e-b498-4b0ef153fc5b', 'attached_at': '', 'detached_at': '', 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'serial': '77432e15-ce98-4ac5-a98b-72240e46a1b3'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:37.976166 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:37.978735 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892', uuid='255cce8a-f08d-4c8e-b498-4b0ef153fc5b'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771517.9778898) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:37.982226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:37.986349 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:37.987008 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:37.988022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:37.988301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:37.990512 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:37.990979 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:37.991218 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:37.991552 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:37.992213 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:37.992213 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:37.992313 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:37.992524 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:37.992924 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:37.992924 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:37.993362 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:37.993362 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:38.008747 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:38.008747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:38.008747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:38.009142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:38.009172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:58:38.022245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:38.023333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:38.023998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:38.024504 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:38.025453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:38.025453 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:38.039846 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:38.039846 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:38.047358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:38.047358 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:38.055288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3] added
May 26 04:58:38.055288 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:38.055288 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:38.055288 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:38.055288 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:38.055288 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:38.055288 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:38.055573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:38.056265 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:38.056265 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:38.063358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3] added
May 26 04:58:38.063358 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:38.063358 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:38.063358 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:38.063358 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:38.063358 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:38.063358 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:38.063679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:38.064572 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0398(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:38.064572 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:38.180162 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:38.182666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:38.234282 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:38.241962 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:38.243105 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:38.243384 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Creating image(s)
May 26 04:58:38.243936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:38.244679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:38.244768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:38.245301 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:38.249137 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:38.251855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:38.347864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:38.348795 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:38.349252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:38.349763 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:38.353256 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:38.353663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:38.373672 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:38.424580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3084bae4-b9d6-478d-b16a-88bdb27f5d53 tempest-DeleteServersTestJSON-81488332 tempest-DeleteServersTestJSON-81488332-project-member] Lock "8a4df71c-706b-4393-a8aa-fdffa726dbda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.015s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:38.454470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:38.454470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:38.513362 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:38.515577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk 1073741824" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:38.522989 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:38.523958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:38.615579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:38.616187 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:58:38.617814 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:38.636824 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:38.682661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2e96709e-e754-4b61-ab06-08af7c3073d9 req-3bb904b0-a397-40b2-970b-4f4d2c44a60a service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:38.710253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:38.712667 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Cannot resize image /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:58:38.713028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:58:38.713273 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Ensure instance console log exists: /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:38.713497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:38.713710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:38.713881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:38.853998 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:39.056319 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:39.064696 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:39.072295 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:39.072295 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:39.079939 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:39.079939 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:39.084847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:39.092760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:39.098729 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:39.098729 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:39.099023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:39.099023 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:39.099334 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 04:58:39.099334 np0000001388 nova-compute[98319]: 
May 26 04:58:39.105537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:39.105537 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:39.105682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 04:58:39.105682 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:39.105682 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 04:58:39.105682 np0000001388 nova-compute[98319]: 
May 26 04:58:39.142774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67c0e90e-4048-4b5f-b222-4f9190d1e2fb req-3329a1dc-57ac-467e-8285-6c71f4be7648 service nova] Releasing lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:39.143160 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:39.143407 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:39.421517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:39.421702 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-3d7b6098-3764-4de0-91cb-6a6ceb63e326. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:39.421890 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:39.421971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:39.422569 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:39.529241 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Booting with volume 449d1c79-8865-431b-8869-e8bacaa4c673 at /dev/vdc
May 26 04:58:39.586519 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:39.601930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:39.631347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:39.663237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:39.663900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:39.678697 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:39.682533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:39.684018 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3'] 
May 26 04:58:39.684517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:39.684986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:39.685406 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:39.685646 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating existing volume attachment record: 9af701a9-7e9b-4c82-a8e2-26f164743cb9 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:39.743694 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:39.750465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:39.750658 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:39.751244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:39.887129 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005197319999297179 future=<Future at 0x7d7ac4316d20 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:39.887603 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:39.888144 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Emitting event <LifecycleEvent: 1779771504.886486, 8a4df71c-706b-4393-a8aa-fdffa726dbda => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:39.888144 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] VM Stopped (Lifecycle Event)
May 26 04:58:39.928455 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:39.936882 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:40.073316 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:40.114372 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updating instance_info_cache with network_info: [{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:40.139007 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.50.100,3260]
May 26 04:58:40.139007 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.50.100,3260] successful.
May 26 04:58:40.139007 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:40.147418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.40.100,3260]
May 26 04:58:40.147418 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.40.100,3260] successful.
May 26 04:58:40.147418 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:40.156741 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:40.163236 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:40.174061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.174061 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.174061 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:40.174507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.174507 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.174507 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:40.178231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:40.178231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:40.178231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('7', '-', '-', 0) found on session 5 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:40.178231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:40.180358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.180358 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.180358 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:40.180616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.180616 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:40.180616 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:40.180907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:40.181021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:40.181593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('8', '-', '-', 0) found on session 6 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:40.181708 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:40.203884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 5 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:40.204028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:40.221938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 6 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:40.222053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:40.286535 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:40.391371 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 8a4df71c-706b-4393-a8aa-fdffa726dbda] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:40.616842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:40.616842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance network_info: |[{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:40.618361 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Start _get_guest_xml network_info=[{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:40.620658 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:40.622309 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-653117587', uuid='f40c13f1-a910-4f6a-b000-2baa84ce86fa'), owner=OwnerMeta(userid='e78b48c4b4dc439086e392b4800b4ad7', username='tempest-ServerActionsTestOtherA-846952046-project-member', projectid='278ea77812db4e90a14904f104739285', projectname='tempest-ServerActionsTestOtherA-846952046'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771520.621886) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:40.623212 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:40.623610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:40.624216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:40.624414 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:40.625532 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:40.625902 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:40.626066 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:40.626173 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:40.626333 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:40.626431 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:40.626542 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:40.626718 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:40.626862 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:40.626990 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:40.627108 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:40.627252 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:40.641854 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-653117587',display_name='tempest-ServerActionsTestOtherA-server-653117587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-653117587',id=9,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-s9a4yv8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=f40c13f1-a910-4f6a-b000-2baa84ce86fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:40.642103 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:40.642827 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:40.643500 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'pci_devices' on Instance uuid f40c13f1-a910-4f6a-b000-2baa84ce86fa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:40.791832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaf84a8d-ba68-4bef-b1e3-8f6908584603 req-4480c15d-0f03-4ae8-9a29-e2e4d6aeed83 service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:40.791832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:40.791832 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:40.917472 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:40.983938 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:40.985260 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-43e8369c-2abf-41ee-8e75-e0471b3094a2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:40.985260 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:41.027957 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:58:41.146055 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <uuid>f40c13f1-a910-4f6a-b000-2baa84ce86fa</uuid>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <name>instance-00000009</name>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-653117587</nova:name>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:40</nova:creationTime>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:user uuid="e78b48c4b4dc439086e392b4800b4ad7">tempest-ServerActionsTestOtherA-846952046-project-member</nova:user>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:project uuid="278ea77812db4e90a14904f104739285">tempest-ServerActionsTestOtherA-846952046</nova:project>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         <nova:port uuid="daeb843a-0159-409b-8390-b08c56ae2515">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="serial">f40c13f1-a910-4f6a-b000-2baa84ce86fa</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="uuid">f40c13f1-a910-4f6a-b000-2baa84ce86fa</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.config"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:fa:7f:17"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <target dev="tapdaeb843a-01"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/console.log" append="off"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:41.146055 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:41.148572 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Preparing to wait for external event network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:41.148572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:41.148572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:41.148572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:41.148572 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-653117587',display_name='tempest-ServerActionsTestOtherA-server-653117587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-653117587',id=9,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-s9a4yv8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=f40c13f1-a910-4f6a-b000-2baa84ce86fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:41.148807 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:41.148807 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:41.148807 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:41.151424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.151741 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:41.152093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:41.152827 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.153036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e575d80-4a4a-5d76-8e0a-8139c8b9e232', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:41.157040 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.158210 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:41.164091 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.164436 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaeb843a-01, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:41.164992 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaeb843a-01, col_values=(('qos', UUID('3b35b3cc-cde6-46b6-a6df-a6c9442be697')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:41.165256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaeb843a-01, col_values=(('external_ids', {'iface-id': 'daeb843a-0159-409b-8390-b08c56ae2515', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:7f:17', 'vm-uuid': 'f40c13f1-a910-4f6a-b000-2baa84ce86fa'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:41.166960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.168843 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:41.176567 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.177558 np0000001388 nova-compute[98319]: INFO os_vif [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01')
May 26 04:58:41.293349 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:41.397012 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:41.507640 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:41.564793 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:41.823130 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:58:41.824219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:58:41.824480 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Creating image(s)
May 26 04:58:41.824799 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 04:58:41.824931 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Ensure instance console log exists: /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:58:41.825143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:41.826589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:41.826922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:41.995766 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:42.047089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Found WWN 330000000439139f5 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:58:42.049122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:42.049122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== connect_volume: return (4039ms) {'type': 'block', 'scsi_wwn': '330000000439139f5', 'path': '/dev/dm-0', 'multipath_id': '330000000439139f5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:42.049122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000439139f5', 'path': '/dev/dm-0', 'multipath_id': '330000000439139f5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:58:42.067983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f186468-63bf-426b-ad4d-7c59334a3663 req-521cbbcb-59a8-4d90-a9f3-3e344138ba25 service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:42.069548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:42.069714 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:42.262693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:42.553353 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1183761892',id=7,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-q4sqwcqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:32Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=255cce8a-f08d-4c8e-b498-4b0ef153fc5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:58:42.553353 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:42.553705 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:42.554078 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:42.572999 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:42.691684 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:42.707629 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:42.707755 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:42.708922 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:fa:7f:17, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:42.709348 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Using config drive
May 26 04:58:42.868173 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:43.056407 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] End _get_guest_xml xml=<domain type="qemu">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <uuid>255cce8a-f08d-4c8e-b498-4b0ef153fc5b</uuid>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <name>instance-00000007</name>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1183761892</nova:name>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:37</nova:creationTime>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         <nova:port uuid="0afa9729-7742-4ca2-a601-24454af57a3c">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <system>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="serial">255cce8a-f08d-4c8e-b498-4b0ef153fc5b</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="uuid">255cce8a-f08d-4c8e-b498-4b0ef153fc5b</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </system>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <os>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </os>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <features>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </features>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   <devices>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <alias name="ua-77432e15-ce98-4ac5-a98b-72240e46a1b3"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <serial>77432e15-ce98-4ac5-a98b-72240e46a1b3</serial>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </disk>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:da:fb:d7"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <target dev="tap0afa9729-77"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </interface>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/console.log" append="off"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </serial>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <video>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </video>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </rng>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:   </devices>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]: </domain>
May 26 04:58:43.056407 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:58:43.059633 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Preparing to wait for external event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:58:43.059633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:43.059633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:43.059633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:43.059633 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1183761892',id=7,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-q4sqwcqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:32Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=255cce8a-f08d-4c8e-b498-4b0ef153fc5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:58:43.059988 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:58:43.062302 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:58:43.062642 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:58:43.062880 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.063075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:43.063280 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:58:43.063922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.064104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99e4c1e0-50b7-5d23-ac8a-0f65e9da08d4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:43.066658 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:43.071351 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.075974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.076176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0afa9729-77, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:43.076596 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0afa9729-77, col_values=(('qos', UUID('a0ae050d-60f6-42a1-8e29-5813c4972a68')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:43.076665 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0afa9729-77, col_values=(('external_ids', {'iface-id': '0afa9729-7742-4ca2-a601-24454af57a3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:fb:d7', 'vm-uuid': '255cce8a-f08d-4c8e-b498-4b0ef153fc5b'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:58:43.079657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.081413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:58:43.087115 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:43.087115 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:43.087115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:43.091544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:43.092614 np0000001388 nova-compute[98319]: INFO os_vif [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77')
May 26 04:58:43.098314 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:43.220253 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:43.370925 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b055d195-6925-485a-ab98-6acaad2261f7 req-c0f66120-3fc9-4dfe-9da7-431a610ede1a service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:43.371330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:43.371493 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:43.393111 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Creating config drive at /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.config
May 26 04:58:43.400442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaxcl7kpx {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:43.454349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpaxcl7kpx" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:43.875175 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:43.969268 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.000506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.010954 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:44.121314 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.296804 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ade6965-beff-46a5-9368-b380889a3e8c req-e81b2613-a7ff-4dac-a4a8-0d2864d36c91 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:44.297466 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ade6965-beff-46a5-9368-b380889a3e8c req-e81b2613-a7ff-4dac-a4a8-0d2864d36c91 service nova] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:44.297712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ade6965-beff-46a5-9368-b380889a3e8c req-e81b2613-a7ff-4dac-a4a8-0d2864d36c91 service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:44.297893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6ade6965-beff-46a5-9368-b380889a3e8c req-e81b2613-a7ff-4dac-a4a8-0d2864d36c91 service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:44.298038 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6ade6965-beff-46a5-9368-b380889a3e8c req-e81b2613-a7ff-4dac-a4a8-0d2864d36c91 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Processing event network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:44.338224 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Successfully updated port: 203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:44.383732 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:44.417132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.424785 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:44.425006 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-203a11b7-726d-4b89-a085-71ee7033cf4b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:44.426256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:44.426352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.430520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.453421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.462474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:44.617751 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:44.617751 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:58:44.617751 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:da:fb:d7, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:58:44.617751 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Using config drive
May 26 04:58:44.840983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:44.885065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-07c00b3f-5267-4cf7-a261-a2a37709cbb7 req-7d2ca863-1835-4954-b308-b6ecb1842d5f service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:44.885487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:44.885697 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:44.962556 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771524.9621415, f40c13f1-a910-4f6a-b000-2baa84ce86fa => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:44.962740 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] VM Started (Lifecycle Event)
May 26 04:58:44.964098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:44.971565 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:44.973152 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance spawned successfully.
May 26 04:58:44.974480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:45.128428 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:45.159810 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:45.160036 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-30fae245-4921-4b63-a1d2-9f7b2a02b90e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:45.161270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:45.284526 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Creating config drive at /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config
May 26 04:58:45.288315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpenb0pao9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:45.333051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpenb0pao9" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:45.388232 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:45.466077 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:45.467865 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:45.488220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.488220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.488220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.488220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.488556 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.488851 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:45.517289 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:45.713741 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:45.815138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:45.847404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:45.937368 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:45.970847 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:45.971170 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771525.9710016, f40c13f1-a910-4f6a-b000-2baa84ce86fa => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:45.971318 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] VM Paused (Lifecycle Event)
May 26 04:58:45.996701 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Took 7.75 seconds to spawn the instance on the hypervisor.
May 26 04:58:45.996994 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:46.009305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:46.216034 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ca48387b-79df-4f18-aeae-5f6b46005bdc req-24d1a401-9496-4657-ab96-9b67718269b2 service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:46.218419 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:46.218647 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:46.401785 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:46.403142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:46.403293 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:46.403533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:46.403533 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] No waiting events found dispatching network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:46.404260 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-cf4d5a2f-f2df-4f79-9501-917312c73916 req-3fb23d82-5994-43b5-9b6d-c721dbbe1bec service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received unexpected event network-vif-plugged-daeb843a-0159-409b-8390-b08c56ae2515 for instance with vm_state active and task_state None.
May 26 04:58:46.473925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:46.479974 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771526.4785721, f40c13f1-a910-4f6a-b000-2baa84ce86fa => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:46.479974 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] VM Resumed (Lifecycle Event)
May 26 04:58:46.510219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:46.523722 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Took 19.54 seconds to build instance.
May 26 04:58:46.525526 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-899ff1cd-226c-4400-ab38-c28a3d657dba req-91ecb834-bd50-4c51-8e9a-7f474146bc89 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:46.525710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-899ff1cd-226c-4400-ab38-c28a3d657dba req-91ecb834-bd50-4c51-8e9a-7f474146bc89 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:46.525926 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-899ff1cd-226c-4400-ab38-c28a3d657dba req-91ecb834-bd50-4c51-8e9a-7f474146bc89 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:46.526369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-899ff1cd-226c-4400-ab38-c28a3d657dba req-91ecb834-bd50-4c51-8e9a-7f474146bc89 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:46.526528 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-899ff1cd-226c-4400-ab38-c28a3d657dba req-91ecb834-bd50-4c51-8e9a-7f474146bc89 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Processing event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:58:46.872493 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:58:46.941575 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:58:46.947283 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:58:46.950888 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance spawned successfully.
May 26 04:58:46.951812 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:58:46.981764 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:46.989891 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:47.029527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-910f0c3b-b00d-4d7c-881d-3b25434e6b7f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:47.123017 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:47.459678 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.460162 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.460230 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.460543 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.460897 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.461176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:58:47.493525 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771527.4931023, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:47.493928 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Started (Lifecycle Event)
May 26 04:58:47.588787 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:47.807451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-changed-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:47.807451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing instance network info cache due to event network-changed-daeb843a-0159-409b-8390-b08c56ae2515. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:58:47.807451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] Acquiring lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:47.807451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] Acquired lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:47.807451 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing network info cache for port daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:47.974603 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Took 10.01 seconds to spawn the instance on the hypervisor.
May 26 04:58:47.974820 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:47.998096 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:47.999755 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:48.054725 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:48.080794 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:48.312566 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:48.488229 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Took 24.37 seconds to build instance.
May 26 04:58:48.504910 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:58:48.505931 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771528.5049984, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:48.505931 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Paused (Lifecycle Event)
May 26 04:58:48.542077 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:48.620787 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:48.621136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:48.621295 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:48.621712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:48.622908 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:48.623071 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-47dbdb50-375c-40a0-993f-1a4a7cc4ed01 req-dbf16702-81a3-4f62-a8d0-d0b2c73e7340 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:58:48.913798 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:48.918323 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:48.994403 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-14993695-9a36-4050-88ac-1d94878ea62b tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.892s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:49.011267 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:49.014525 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771529.0141842, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:58:49.014739 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Resumed (Lifecycle Event)
May 26 04:58:49.202307 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:49.322187 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updated VIF entry in instance network info cache for port daeb843a-0159-409b-8390-b08c56ae2515. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:49.324174 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updating instance_info_cache with network_info: [{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:49.518280 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:58:49.522113 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:58:49.714799 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:49.829760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3de3cd48-496a-439d-a5e5-3f70ea6ff27d req-bdc0940b-19e1-4ed4-8e89-a2be32f3436e service nova] Releasing lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:50.227164 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:50.423883 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:50.681306 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Rescuing
May 26 04:58:50.681889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:58:50.681889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:50.681889 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:58:50.930621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:50.931322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance network_info: |[{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:58:50.931830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:58:50.932069 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port 30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:58:50.934803 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Start _get_guest_xml network_info=[{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'f6fb0550-f685-4259-b863-1c040d1dd494', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d47d0b8-fefe-4218-9bd0-08c318e7484a', 'attached_at': '', 'detached_at': '', 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'serial': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '49cfa873-672b-4583-98b6-0124899b5b0e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d47d0b8-fefe-4218-9bd0-08c318e7484a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'serial': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': '9af701a9-7e9b-4c82-a8e2-26f164743cb9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0d47d0b8-fefe-4218-9bd0-08c318e7484a', 'attached_at': '', 'detached_at': '', 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'serial': '449d1c79-8865-431b-8869-e8bacaa4c673'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:50.939495 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:50.941779 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-290168394', uuid='0d47d0b8-fefe-4218-9bd0-08c318e7484a'), owner=OwnerMeta(userid='9381b603332a4888bbcde18a945c56a1', username='tempest-TaggedBootDevicesTest-1451569092-project-member', projectid='a773253d42414a86a7ee9ed5a1939fdc', projectname='tempest-TaggedBootDevicesTest-1451569092'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771530.9409788) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:50.943566 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:50.944101 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:50.945431 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:50.945779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:50.947121 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:50.947755 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:50.948465 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:50.949024 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:50.949350 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:50.949601 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:50.949998 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:50.951090 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:50.951090 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:50.951090 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:50.951090 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:50.953271 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:50.963080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:50.963545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:50.963945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:50.964479 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:50.965161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:58:50.980817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:50.980817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:50.980817 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:50.982848 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:50.986066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:50.986811 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:50.997586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:50.997586 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:51.007256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:51.007256 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:51.014337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012] added
May 26 04:58:51.014337 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:51.014337 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:51.014337 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:51.014337 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:51.014337 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:51.014337 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:51.014633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:51.014795 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0339(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:51.015003 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:51.022010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012] added
May 26 04:58:51.022010 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:51.022010 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:51.022010 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:51.022010 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:51.022010 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:51.022010 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:51.022255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:51.022550 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:51.022660 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:51.044916 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:51.185333 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:51.439081 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:51.515329 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:51.530082 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:51.712836 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:51.842719 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:52.013355 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updated VIF entry in instance network info cache for port 30fae245-4921-4b63-a1d2-9f7b2a02b90e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:58:52.014063 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:58:52.015745 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:52.023181 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:52.032438 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:52.032438 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:52.044666 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:52.044666 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.055034 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.064229 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.075338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.075338 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.075338 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.075338 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.075338 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:52.075548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.075548 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.075548 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.075548 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.075548 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:52.080612 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.080612 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.080612 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.080612 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.080612 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:52.080796 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.080796 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.080796 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.080796 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.080796 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:52.116711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.40.100,3260]
May 26 04:58:52.116711 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.40.100,3260] successful.
May 26 04:58:52.116711 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.122445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.50.100,3260]
May 26 04:58:52.122445 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.50.100,3260] successful.
May 26 04:58:52.122445 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.130822 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.136381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.149226 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:52.149226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:52.149804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('11', '-', '-', 0) found on session 9 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:52.149804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.158624 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: tcp: [8] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d67342da-3128-4435-a33c-36b9c9690fd9 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:52.158947 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:52.159604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:52.159831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:52.161169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('12', '-', '-', 0) found on session 10 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:52.161400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:52.173944 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 9 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:52.173944 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:52.206230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 10 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:52.206230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:52.215191 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:52.516555 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2047bd79-3239-4d81-9643-ac01ae0f13fd req-fa26f63e-8459-4158-b815-3e9889d128ee service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:58:52.986402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:58:53.084746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:53.869336 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:53.879850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:53.896054 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:54.008810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Found WWN 3300000009ec5764f for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:58:54.009221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.045s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:54.009878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '3300000009ec5764f', 'path': '/dev/dm-4', 'multipath_id': '3300000009ec5764f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:54.009878 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009ec5764f', 'path': '/dev/dm-4', 'multipath_id': '3300000009ec5764f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:58:54.079840 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:54.081299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:54.082960 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:54.082960 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:54.082960 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:54.082960 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-315f3408-7228-4b09-adaf-694a7e1482ef req-f79e1418-697e-43b9-9739-2e718be0fe8a service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state rescuing.
May 26 04:58:54.086562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:54.096134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:54.205496 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998580128000185 future=<Future at 0x7d7ac43de9f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:54.205496 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998277441000027 future=<Future at 0x7d7ac43de9f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:54.205496 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99815212600015 future=<Future at 0x7d7ac43de9f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:58:54.211836 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance destroyed successfully.
May 26 04:58:54.212285 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'numa_topology' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:54.228754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:54.229209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:54.521876 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:54.522225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:54.522403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:54.524286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:54.524286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:58:54.541893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:54.542605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:54.543166 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:54.543435 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:54.544056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:54.544343 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:54.557721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:54.557721 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:54.563926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:54.563926 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:54.570185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6] added
May 26 04:58:54.570185 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:54.570185 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:54.570185 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:54.570185 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:54.570185 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:54.570185 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:54.570459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:54.570535 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:54.570672 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:54.576173 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6] added
May 26 04:58:54.576173 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:54.576173 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:54.576173 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:54.576173 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:54.576173 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:54.576173 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:54.576403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:54.576560 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0323(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:54.576706 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:54.720363 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Attempting a stable device rescue
May 26 04:58:54.732112 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:58:54.833568 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 04:58:54.838219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 04:58:54.838219 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Creating image(s)
May 26 04:58:54.839314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:54.839502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:54.840139 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:54.840366 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:55.305340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:55.305957 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:55.309732 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:58:55.309865 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Claim successful on node np0000001388
May 26 04:58:55.342272 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:58:55.342642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:55.343096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:55.399946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:55.400107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:55.571165 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:55.579716 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:55.589261 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:55.589261 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:55.599615 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:55.599615 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.607735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.617743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.632418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.632418 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.632418 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.632418 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.632418 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.636834 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:55.684451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.50.100,3260]
May 26 04:58:55.684451 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.50.100,3260] successful.
May 26 04:58:55.684451 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.684823 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.40.100,3260]
May 26 04:58:55.684823 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.40.100,3260] successful.
May 26 04:58:55.684823 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.695496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.706301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.715490 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.715779 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:55.715965 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:55.716141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:55.716852 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('10', '-', '-', 0) found on session 12 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:55.716996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.723188 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:55.723376 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:55.723559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:55.723659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:55.724311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('9', '-', '-', 0) found on session 11 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:55.724424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:55.734463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 12 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:55.734938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:55.749343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 11 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:55.749343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:55.908944 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lazy-loading 'flavor' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:56.248459 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:58:56.248648 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:56.252326 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:56.252452 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:56.252640 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:58:56.254920 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-12e86071-fd56-402f-817a-eaed396b0837 req-2ab47a6d-158d-407e-a155-e4be1b06bc3d service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state rescuing.
May 26 04:58:56.351821 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.357865 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.358320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:56.431320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.part --force-share --output=json" returned: 0 in 0.073s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:56.431715 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] 9194b16a-3d21-4e1b-86c1-ed472851b88b was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 04:58:56.432485 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 04:58:56.433887 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.part /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:56.516521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.part /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.converted" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:56.519458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:56.523098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:56.545038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:58:56.598889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:56.765720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:56.773354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1.converted --force-share --output=json" returned: 0 in 0.245s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:56.775338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.432s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:56.775994 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.781369 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.786951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:56.787423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:56.787807 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.792326 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:58:56.792698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:56.876896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1 --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:56.877434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1,backing_fmt=raw /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:56.920623 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:56.922545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1,backing_fmt=raw /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.rescue" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:56.922986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "9dd44c70d72ee2a2c541d74401f1d8ce35ef74e1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:56.923283 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'migration_context' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:57.126629 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:58:57.126847 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:58:57.276607 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'flavor' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:57.425810 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:58:57.426212 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:58:57.427006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start _get_guest_xml network_info=[{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:da:fb:d7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9194b16a-3d21-4e1b-86c1-ed472851b88b', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '5b56076b-e06a-4c16-bb7a-ef55a6355115', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '255cce8a-f08d-4c8e-b498-4b0ef153fc5b', 'attached_at': '', 'detached_at': '', 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'serial': '77432e15-ce98-4ac5-a98b-72240e46a1b3'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:58:57.427277 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:57.566157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Found WWN 330000000d2f33010 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:58:57.566669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:57.566909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '330000000d2f33010', 'path': '/dev/dm-1', 'multipath_id': '330000000d2f33010'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:57.567091 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d2f33010', 'path': '/dev/dm-1', 'multipath_id': '330000000d2f33010'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:58:57.632500 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:58:57.929219 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:58:57.931287 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:58:57.932534 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892', uuid='255cce8a-f08d-4c8e-b498-4b0ef153fc5b'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:da:fb:d7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771537.932133) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:58:57.933507 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:58:57.933845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:58:57.934698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:58:57.934883 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:58:57.935820 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:58:57.936135 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:58:57.936280 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:58:57.936389 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:58:57.936506 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:58:57.936591 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:58:57.936682 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:58:57.936835 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:58:57.936936 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:58:57.937050 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:58:57.937264 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:58:57.937434 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:58:57.937568 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:58:58.074807 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:58.075470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:58.075773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:58.076319 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:58.076833 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:58:58.086860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:58:58.091404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:58.092665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:58.093566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:58.093740 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:58.094476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:58:58.094717 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:58.114109 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:58.114109 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:58.117189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:58:58.117189 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:58.127174 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673] added
May 26 04:58:58.127174 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:58.127174 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:58.127174 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:58.127174 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:58.127174 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:58.127174 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:58.127553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:58.127603 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:58.127762 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:58.136028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673] added
May 26 04:58:58.136028 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:58:58.136028 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:58.136028 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:58.136028 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:58:58.136028 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:58:58.136028 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:58.137667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.831s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:58.139334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:58:58.139625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:58:58.142880 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0449(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:58:58.142880 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:58:58.284457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.519s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:58.439575 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:58:58.452497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:58.470558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:58.471266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:58.471753 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Attaching volume 6b36577d-8405-4591-b8a8-76d1aa4156d4 to /dev/vdb
May 26 04:58:58.531837 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:58.535514 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:58:58.535985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:58.536889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:58.537741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:58:58.538214 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:58.538598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:58.538903 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:58.546489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:58.571850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:58.601728 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:58.602412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:58.613171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:58.615035 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 04:58:58.615035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:58.615235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:58.615537 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:58.615941 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating existing volume attachment record: 1ec044c2-4b44-4629-a8f3-38ff0b5d5892 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:58.649431 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:58:58.649431 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:58:58.649431 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:58.650093 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:58:58.758784 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e56d19720934fccb862b18021b97675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fec238eac0a44f19ba4295e8c72b582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:58:59.128741 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:59.146401 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:59.146401 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.157101 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:58:59.164332 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:58:59.164332 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.173520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.184171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.194021 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:59.194891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.195336 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:59.195851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:59.196020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.205386 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.205643 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:59.236972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:58:59.237214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:58:59.237436 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attaching volume 575b9d98-8caa-44b9-814a-7e29ce2fc18b to /dev/vdb
May 26 04:58:59.242041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.40.100,3260]
May 26 04:58:59.242041 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.40.100,3260] successful.
May 26 04:58:59.242041 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.249841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.50.100,3260]
May 26 04:58:59.249841 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.50.100,3260] successful.
May 26 04:58:59.249841 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.264356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.280352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.287486 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.287866 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:59.288170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:59.288170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:59.289027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('13', '-', '-', 0) found on session 13 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:59.289107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:59.295271 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.303530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:58:59.303830 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:58:59.304107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:58:59.304107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:58:59.305429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] HCTL ('14', '-', '-', 0) found on session 14 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:58:59.305429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:58:59.317950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 13 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:59.318169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:59.321294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:58:59.337408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Searching for a device in session 14 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:58:59.337408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:58:59.351086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:58:59.384845 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Successfully created port: 4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:58:59.391408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:58:59.391746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:58:59.407412 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating existing volume attachment record: c6cb8dd7-b7e7-4797-b249-414fcd86c5d9 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:58:59.663726 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:58:59.963357 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Successfully updated port: 4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:58:59.984102 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:58:59.985798 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:58:59.985978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:00.036035 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-changed-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:00.036590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Refreshing instance network info cache due to event network-changed-4cca346b-bc09-4cf8-957b-138449d50f56. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:00.036868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] Acquiring lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:00.037061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] Acquired lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:00.037245 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Refreshing network info cache for port 4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:00.094192 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:00.465662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:00.539524 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:00.614668 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:00.674231 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:00.678265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:00.678265 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Creating image(s)
May 26 04:59:00.678265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:00.678265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:00.678265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:00.678822 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:00.684105 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:00.688111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:00.780061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:00.780751 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:00.781306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:00.781889 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:00.785604 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:00.785965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:00.836025 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:00.875238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:00.875471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:00.918083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk 1073741824" returned: 0 in 0.042s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:00.918691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:00.920920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:01.010688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:01.011239 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:01.011516 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:01.093949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:01.094328 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Cannot resize image /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:01.095173 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:59:01.095350 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Ensure instance console log exists: /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:01.096655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:01.096886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:01.097017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:01.109300 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Found WWN 3300000005b4cff93 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:01.109710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:01.109941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000005b4cff93', 'path': '/dev/dm-2', 'multipath_id': '3300000005b4cff93'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:01.110156 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000005b4cff93', 'path': '/dev/dm-2', 'multipath_id': '3300000005b4cff93'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:01.111870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.573s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:01.112274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:01.123616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:01.123935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:01.124159 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:01.125179 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:01.125687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:01.125903 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:01.137085 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:01.137085 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:01.146222 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:01.146222 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:01.153221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:01.157333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.172293 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.172679 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:01.172679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:01.172954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:01.173662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('8', '0', '0', 0) found on session 6 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:01.174056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 8 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.179557 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:01.179814 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:01.179989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.054s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:01.180066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:01.180659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('7', '0', '0', 0) found on session 5 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:01.182838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 7 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:01.183793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 6 and hctl ('8', '0', '0', 0) yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:01.184031 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:01.193289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 5 and hctl ('7', '0', '0', 0) yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:01.193444 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:01.339563 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75e7c99f-5adf-496a-ab94-abd374dc8ed7 req-289bcfc1-f6e2-4d98-843e-6935bf8d849c service nova] Releasing lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:01.340009 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquired lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:01.340180 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:01.522429 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:01.620375 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.620375 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.621072 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.621858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.621993 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.626229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.626798 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.627030 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.627507 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.628175 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.628519 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.628981 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.630838 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:01.630838 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:01.630838 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:01.631417 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d47d0b8-fefe-4218-9bd0-08c318e7484a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:01.928672 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:02.128395 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:02.136088 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <uuid>0d47d0b8-fefe-4218-9bd0-08c318e7484a</uuid>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <name>instance-00000008</name>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-290168394</nova:name>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:50</nova:creationTime>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:user uuid="9381b603332a4888bbcde18a945c56a1">tempest-TaggedBootDevicesTest-1451569092-project-member</nova:user>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:project uuid="a773253d42414a86a7ee9ed5a1939fdc">tempest-TaggedBootDevicesTest-1451569092</nova:project>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="a7ef8ccb-c585-4d52-821d-9625a7566f42">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="3d7b6098-3764-4de0-91cb-6a6ceb63e326">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.155" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="43e8369c-2abf-41ee-8e75-e0471b3094a2">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="30fae245-4921-4b63-a1d2-9f7b2a02b90e">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         <nova:port uuid="203a11b7-726d-4b89-a085-71ee7033cf4b">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="serial">0d47d0b8-fefe-4218-9bd0-08c318e7484a</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="uuid">0d47d0b8-fefe-4218-9bd0-08c318e7484a</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/disk.config"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <alias name="ua-9c8b09ab-5693-422c-93c6-0d2c6dbd3012"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <serial>9c8b09ab-5693-422c-93c6-0d2c6dbd3012</serial>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <alias name="ua-f159b9f6-498a-4d19-a57a-adb7cf50d9e6"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <serial>f159b9f6-498a-4d19-a57a-adb7cf50d9e6</serial>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <alias name="ua-449d1c79-8865-431b-8869-e8bacaa4c673"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <serial>449d1c79-8865-431b-8869-e8bacaa4c673</serial>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:55:64:fe"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tapa7ef8ccb-c5"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:4c:58:22"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap3d7b6098-37"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:d7:21:8f"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap98a60a4c-e6"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:03:14:a3"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap43e8369c-2a"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b8:92:2f"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap2b9c11dd-15"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:10:61:df"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap30fae245-49"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:8b:ae:47"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <target dev="tap203a11b7-72"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/console.log" append="off"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:02.136088 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Preparing to wait for external event network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:02.140819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:02.141729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:02.141729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:02.142269 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.142443 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.142863 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.143127 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.144190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.146844 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:02.148735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.149227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.150448 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.150723 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '859f271d-180b-5d19-a84f-89813edb2031', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.157744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.158891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.164446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.170020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.170288 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7ef8ccb-c5, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.170610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa7ef8ccb-c5, col_values=(('qos', UUID('3698f204-07aa-4321-ab76-22b7a8def1c8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.170729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa7ef8ccb-c5, col_values=(('external_ids', {'iface-id': 'a7ef8ccb-c585-4d52-821d-9625a7566f42', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:64:fe', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.171574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.172683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.186542 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.187456 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5')
May 26 04:59:02.189289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.189289 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.189289 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.190598 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.190969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.191228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.191387 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.192154 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.192310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f617e70b-bd63-564b-b00d-135529b1a91d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.193846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.194746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.205869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.208080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.208080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d7b6098-37, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.208734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3d7b6098-37, col_values=(('qos', UUID('5a525df5-b6e0-440f-a94e-45073f5541c1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.208954 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3d7b6098-37, col_values=(('external_ids', {'iface-id': '3d7b6098-3764-4de0-91cb-6a6ceb63e326', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:58:22', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.210249 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.213221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.225775 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.226721 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37')
May 26 04:59:02.227403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.227576 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.228014 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.228286 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.228578 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.228748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.228886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.229715 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.229858 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '22f2d819-14b0-5630-ab22-b0fcb1f9c0eb', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.234877 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.248706 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.254226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.254226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98a60a4c-e6, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.254226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98a60a4c-e6, col_values=(('qos', UUID('c52aa59a-cf78-4729-afc5-4a48e08b4b99')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.254226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98a60a4c-e6, col_values=(('external_ids', {'iface-id': '98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:21:8f', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.256219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.256558 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.281093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.284226 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6')
May 26 04:59:02.284226 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.284226 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.284226 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.284630 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.284740 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.285025 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.286212 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.290216 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.290461 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1297b16a-fb94-5258-8ba4-8cb17633c4c3', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.291689 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.292324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.313255 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.316968 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.316968 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43e8369c-2a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.317191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43e8369c-2a, col_values=(('qos', UUID('3577e9a4-8de0-4066-a4f2-f417a465f2aa')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.317248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43e8369c-2a, col_values=(('external_ids', {'iface-id': '43e8369c-2abf-41ee-8e75-e0471b3094a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:14:a3', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.318824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.319983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.340967 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Updating instance_info_cache with network_info: [{"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:02.345073 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.346496 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a')
May 26 04:59:02.347024 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.347569 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.347741 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.347947 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.348352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.348683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.350036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.350036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.350159 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5f8d6ee-d1e9-5687-a3a7-7ecce7c3de5a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.350991 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.352019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.381988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.385219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.385498 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2b9c11dd-15, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.385835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2b9c11dd-15, col_values=(('qos', UUID('2535ce05-7cbf-4cc7-a841-c5a7e4194c8b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.386031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2b9c11dd-15, col_values=(('external_ids', {'iface-id': '2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:92:2f', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.386815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.387908 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.417258 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.418310 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15')
May 26 04:59:02.419000 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.419224 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.419672 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.419914 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.420229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.420472 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.420668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.421576 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.421799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6987d70-0e58-52cf-a862-0bfa98419d56', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.422586 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.423307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.454855 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.457302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.457450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30fae245-49, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.457793 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30fae245-49, col_values=(('qos', UUID('6fb5df03-5c96-4352-8d0f-df0f65065901')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.457946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30fae245-49, col_values=(('external_ids', {'iface-id': '30fae245-4921-4b63-a1d2-9f7b2a02b90e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:61:df', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.458835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.460248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.495975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.497248 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49')
May 26 04:59:02.497946 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.500224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:02.500724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.501256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf998a59-d8e7-5c04-b93e-803cfed35654', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.503985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.503985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.537888 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.540336 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.540579 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap203a11b7-72, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.540966 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap203a11b7-72, col_values=(('qos', UUID('37ed73ab-9e4f-4c57-a554-ee197ece6aaa')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.541177 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap203a11b7-72, col_values=(('external_ids', {'iface-id': '203a11b7-726d-4b89-a085-71ee7033cf4b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:ae:47', 'vm-uuid': '0d47d0b8-fefe-4218-9bd0-08c318e7484a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:02.541986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.543060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:02.583132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:02.585350 np0000001388 nova-compute[98319]: INFO os_vif [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72')
May 26 04:59:02.843796 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Releasing lock "refresh_cache-6b3962c4-d73d-4c08-a0bf-751265f8b607" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:02.843941 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance network_info: |[{"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:02.845541 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Start _get_guest_xml network_info=[{"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:02.847896 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:02.849039 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-74587674', uuid='6b3962c4-d73d-4c08-a0bf-751265f8b607'), owner=OwnerMeta(userid='1e56d19720934fccb862b18021b97675', username='tempest-ServersNegativeTestJSON-1974443015-project-member', projectid='6fec238eac0a44f19ba4295e8c72b582', projectname='tempest-ServersNegativeTestJSON-1974443015'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771542.8486726) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:02.850344 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:02.850711 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:02.851442 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:02.851703 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:02.852626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:02.852912 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:02.853040 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:02.853186 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:02.853262 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:02.853343 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:02.853463 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:02.853603 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:02.853730 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:02.853803 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:02.853883 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:02.853987 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:02.864122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-74587674',display_name='tempest-ServersNegativeTestJSON-server-74587674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-74587674',id=10,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-cu7ycdb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:00Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=6b3962c4-d73d-4c08-a0bf-751265f8b607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:02.864443 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:02.864772 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:02.865552 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lazy-loading 'pci_devices' on Instance uuid 6b3962c4-d73d-4c08-a0bf-751265f8b607 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:03.146485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Found WWN 330000000439139f5 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:03.146984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:03.146984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== connect_volume: return (4608ms) {'type': 'block', 'scsi_wwn': '330000000439139f5', 'path': '/dev/dm-0', 'multipath_id': '330000000439139f5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:03.147125 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000439139f5', 'path': '/dev/dm-0', 'multipath_id': '330000000439139f5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:03.147985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.952s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:03.147985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:03.160955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:03.161644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:03.162607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:03.162800 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:03.163211 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:03.163537 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:03.180901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:03.180901 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:03.181660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:03.181660 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:03.194099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4] added
May 26 04:59:03.194099 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:03.194099 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:03.194099 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:03.194099 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:03.194099 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:03.194099 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:03.194392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:03.194615 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:03.194811 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:03.198218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4] added
May 26 04:59:03.198218 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:03.198218 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:03.198218 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:03.198218 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:03.198218 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:03.198218 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:03.198427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:03.198518 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:03.198614 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:03.368082 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <uuid>6b3962c4-d73d-4c08-a0bf-751265f8b607</uuid>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <name>instance-0000000a</name>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServersNegativeTestJSON-server-74587674</nova:name>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:02</nova:creationTime>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:user uuid="1e56d19720934fccb862b18021b97675">tempest-ServersNegativeTestJSON-1974443015-project-member</nova:user>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:project uuid="6fec238eac0a44f19ba4295e8c72b582">tempest-ServersNegativeTestJSON-1974443015</nova:project>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         <nova:port uuid="4cca346b-bc09-4cf8-957b-138449d50f56">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="serial">6b3962c4-d73d-4c08-a0bf-751265f8b607</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="uuid">6b3962c4-d73d-4c08-a0bf-751265f8b607</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.config"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:fa:c9:fe"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <target dev="tap4cca346b-bc"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/console.log" append="off"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:03.368082 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Preparing to wait for external event network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-74587674',display_name='tempest-ServersNegativeTestJSON-server-74587674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-74587674',id=10,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-cu7ycdb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:00Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=6b3962c4-d73d-4c08-a0bf-751265f8b607,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.372041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a31c53b-f04c-5c2d-b195-fbcaec9a3eab', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:03.376219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.376219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:03.415895 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.418291 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.418447 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cca346b-bc, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:03.418677 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cca346b-bc, col_values=(('qos', UUID('05f690ba-316f-4ed7-b8f3-2ba13f8e1cdb')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:03.419345 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cca346b-bc, col_values=(('external_ids', {'iface-id': '4cca346b-bc09-4cf8-957b-138449d50f56', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:c9:fe', 'vm-uuid': '6b3962c4-d73d-4c08-a0bf-751265f8b607'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:03.419520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.420809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:03.461548 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:03.462627 np0000001388 nova-compute[98319]: INFO os_vif [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc')
May 26 04:59:03.654774 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1183761892',id=7,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:47Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-q4sqwcqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:58:48Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=255cce8a-f08d-4c8e-b498-4b0ef153fc5b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:da:fb:d7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:03.655281 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:da:fb:d7"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:03.655767 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:03.656370 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:04.106877 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:04.108325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:04.108325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] No VIF found with MAC fa:16:3e:55:64:fe, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:04.108325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] No VIF found with MAC fa:16:3e:b8:92:2f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:04.108325 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Using config drive
May 26 04:59:04.158348 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:59:04.159923 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <uuid>255cce8a-f08d-4c8e-b498-4b0ef153fc5b</uuid>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <name>instance-00000007</name>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1183761892</nova:name>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:58:57</nova:creationTime>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         <nova:port uuid="0afa9729-7742-4ca2-a601-24454af57a3c">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="serial">255cce8a-f08d-4c8e-b498-4b0ef153fc5b</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="uuid">255cce8a-f08d-4c8e-b498-4b0ef153fc5b</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <alias name="ua-77432e15-ce98-4ac5-a98b-72240e46a1b3"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <serial>77432e15-ce98-4ac5-a98b-72240e46a1b3</serial>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.rescue"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <boot order="1"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:da:fb:d7"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <target dev="tap0afa9729-77"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/console.log" append="off"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:04.159923 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:04.164965 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance destroyed successfully.
May 26 04:59:04.195302 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:04.199043 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:04.213839 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:04.213839 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:04.218782 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:04.218782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.228809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.236418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.252610 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.258128 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.258475 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:04.307035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.40.100,3260]
May 26 04:59:04.307035 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.40.100,3260] successful.
May 26 04:59:04.307035 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.322692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.323659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.50.100,3260]
May 26 04:59:04.323659 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.50.100,3260] successful.
May 26 04:59:04.323659 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.340863 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.345636 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] HCTL ('15', '-', '-', 0) found on session 15 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:04.345636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.362002 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:04.362604 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:04.363522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:04.363681 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:04.364869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Searching for a device in session 15 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:04.364869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:04.365580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] HCTL ('16', '-', '-', 0) found on session 16 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:04.365722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:04.381332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Searching for a device in session 16 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:04.381332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:04.623718 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:04.792601 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Creating config drive at /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/disk.config
May 26 04:59:04.797664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqe8wbdiz {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:04.845740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqe8wbdiz" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:04.979934 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:04.980077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:04.980274 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No VIF found with MAC fa:16:3e:fa:c9:fe, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:04.980925 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Using config drive
May 26 04:59:05.163571 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:05.322356 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.389970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.398301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.454117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.489708 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:05.591817 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.622864 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.628162 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.652523 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.674982 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Creating config drive at /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.config
May 26 04:59:05.682614 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp426c61le {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:05.696701 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.708727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:05.708727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:05.708727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:05.708727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:da:fb:d7, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:05.710580 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Using config drive
May 26 04:59:05.722540 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.726216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp426c61le" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:05.741807 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9e0ccade-5ebf-4c01-91c6-debefc01280d req-d7ac6a71-079e-4baa-820c-31908f65f814 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:05.742397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e0ccade-5ebf-4c01-91c6-debefc01280d req-d7ac6a71-079e-4baa-820c-31908f65f814 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:05.743003 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e0ccade-5ebf-4c01-91c6-debefc01280d req-d7ac6a71-079e-4baa-820c-31908f65f814 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:05.743364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e0ccade-5ebf-4c01-91c6-debefc01280d req-d7ac6a71-079e-4baa-820c-31908f65f814 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:05.743860 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9e0ccade-5ebf-4c01-91c6-debefc01280d req-d7ac6a71-079e-4baa-820c-31908f65f814 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:05.747330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.776474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.781846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.836325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.863814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:05.916213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.063273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.087631 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.185009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Found WWN 330000000ca27e8b1 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] <== connect_volume: return (6989ms) {'type': 'block', 'scsi_wwn': '330000000ca27e8b1', 'path': '/dev/dm-3', 'multipath_id': '330000000ca27e8b1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ca27e8b1', 'path': '/dev/dm-3', 'multipath_id': '330000000ca27e8b1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 6.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:06.187865 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.188711 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.198906 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lazy-loading 'flavor' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:06.201556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:06.202349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:06.203857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:06.204105 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:06.205131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:06.205333 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:06.214347 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'ec2_ids' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:06.218071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:06.218071 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:06.220398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:06.220398 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 04:59:06.233655 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:06.233655 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:06.233655 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:06.236453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 04:59:06.236453 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:06.236453 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:06.236453 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:06.236453 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:06.236453 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:06.236453 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:06.236907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:06.236907 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0315(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:06.237034 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:06.322705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.340398 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.351013 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.381604 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.399774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.400458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.416534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.456110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.527440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.568007 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.639058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.703816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Attempting to attach volume 6b36577d-8405-4591-b8a8-76d1aa4156d4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 04:59:06.705488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] attach device xml: <disk type="block" device="disk">
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:   <alias name="ua-6b36577d-8405-4591-b8a8-76d1aa4156d4"/>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:   <serial>6b36577d-8405-4591-b8a8-76d1aa4156d4</serial>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:06.705488 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 04:59:06.720604 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:59:06.720604 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'keypairs' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:06.733096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.742259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.764286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.799728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1a6bcad9-e4af-4d74-aa3a-76dee068e57e req-fbd06255-e3de-421b-baa7-d74b767224c5 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:06.799896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a6bcad9-e4af-4d74-aa3a-76dee068e57e req-fbd06255-e3de-421b-baa7-d74b767224c5 service nova] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:06.800055 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a6bcad9-e4af-4d74-aa3a-76dee068e57e req-fbd06255-e3de-421b-baa7-d74b767224c5 service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:06.800177 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a6bcad9-e4af-4d74-aa3a-76dee068e57e req-fbd06255-e3de-421b-baa7-d74b767224c5 service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:06.800344 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1a6bcad9-e4af-4d74-aa3a-76dee068e57e req-fbd06255-e3de-421b-baa7-d74b767224c5 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Processing event network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:06.919693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:06.928533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.124663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.131239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.224466 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:59:07.227719 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:07.239604 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:07.242946 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:07.255072 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:07.255072 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:07.265755 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:07.265755 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.279406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.292382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.308743 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.320591 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.320961 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:07.382703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 04:59:07.382703 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 04:59:07.382703 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.390170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 04:59:07.390170 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 04:59:07.390170 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.401335 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.413484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.431137 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.226s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:07.431137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('17', '-', '-', 0) found on session 17 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:07.436413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:07.436413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:07.439615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('18', '-', '-', 0) found on session 18 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:07.440091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:07.486027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 17 and hctl ['17', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:07.486027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 18 and hctl ['18', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:07.486027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:07.564951 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Creating config drive at /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config.rescue
May 26 04:59:07.568633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4yxke2ph {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:07.627781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4yxke2ph" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:07.636694 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.654684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.664095 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.693712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.704416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 in dict_keys([('network-vif-plugged', '3d7b6098-3764-4de0-91cb-6a6ceb63e326'), ('network-vif-plugged', '98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69'), ('network-vif-plugged', '43e8369c-2abf-41ee-8e75-e0471b3094a2'), ('network-vif-plugged', '2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2'), ('network-vif-plugged', '30fae245-4921-4b63-a1d2-9f7b2a02b90e'), ('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 for instance with vm_state building and task_state spawning.
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.856250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.858903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.860113 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:07.860317 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.860504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.861056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.861904 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.862754 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 in dict_keys([('network-vif-plugged', '98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69'), ('network-vif-plugged', '43e8369c-2abf-41ee-8e75-e0471b3094a2'), ('network-vif-plugged', '2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2'), ('network-vif-plugged', '30fae245-4921-4b63-a1d2-9f7b2a02b90e'), ('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:07.862754 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-3d7b6098-3764-4de0-91cb-6a6ceb63e326 for instance with vm_state building and task_state spawning.
May 26 04:59:07.864927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.867322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.867859 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 in dict_keys([('network-vif-plugged', '43e8369c-2abf-41ee-8e75-e0471b3094a2'), ('network-vif-plugged', '2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2'), ('network-vif-plugged', '30fae245-4921-4b63-a1d2-9f7b2a02b90e'), ('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:07.867859 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 for instance with vm_state building and task_state spawning.
May 26 04:59:07.867859 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.868027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.868273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.868871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.869000 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:07.869550 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.869667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.869911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.869985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.870699 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 in dict_keys([('network-vif-plugged', '2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2'), ('network-vif-plugged', '30fae245-4921-4b63-a1d2-9f7b2a02b90e'), ('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:07.870699 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 for instance with vm_state building and task_state spawning.
May 26 04:59:07.870699 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.870953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.870994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.871189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.871408 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:07.871547 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.871547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.871657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.871748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.871875 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 in dict_keys([('network-vif-plugged', '30fae245-4921-4b63-a1d2-9f7b2a02b90e'), ('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:07.871987 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 for instance with vm_state building and task_state spawning.
May 26 04:59:07.872138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:07.872462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:07.872722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:07.872722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:07.872874 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95c5fd63-e1e4-46ee-bf57-a34542d32336 req-11868343-f2d1-4467-a95e-0c597ff9f545 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:07.912606 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771547.9120836, 0d47d0b8-fefe-4218-9bd0-08c318e7484a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:07.912840 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] VM Started (Lifecycle Event)
May 26 04:59:08.003887 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:08.007135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:08.010609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.012025 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance spawned successfully.
May 26 04:59:08.012519 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:08.016941 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.211431 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.236662 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.246810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.345320 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.418315 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:08.420777 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.427417 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771548.426992, 0d47d0b8-fefe-4218-9bd0-08c318e7484a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:08.427619 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] VM Paused (Lifecycle Event)
May 26 04:59:08.453149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:08.455229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:08.455229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:08.455229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] No VIF found with MAC fa:16:3e:83:c2:ac, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:08.468290 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.481062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 17 and hctl ['17', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:08.481062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:08.496494 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.528741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:08.707485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:08.707725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:08.707956 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:08.711459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:08.711639 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:08.711765 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-bc0a5c44-4252-4995-9c80-c098981b0a0b req-21088028-4593-4a08-88a0-8570afb75e27 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state rescuing.
May 26 04:59:08.817317 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.818013 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:08.820043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:08.820247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:08.895915 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:08.896601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:08.896860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:08.897111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:08.897419 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] No waiting events found dispatching network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:08.897752 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received unexpected event network-vif-plugged-4cca346b-bc09-4cf8-957b-138449d50f56 for instance with vm_state building and task_state spawning.
May 26 04:59:08.898165 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:08.898630 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing instance network info cache due to event network-changed-25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:08.898867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Acquiring lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:08.899053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Acquired lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:08.899319 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Refreshing network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:08.931639 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:08.933054 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:09.034405 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Took 8.36 seconds to spawn the instance on the hypervisor.
May 26 04:59:09.034569 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:09.139791 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1c2a899-dce0-4266-b44c-01ca2adb3b77 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:09.205234 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.001507996999862371 future=<Future at 0x7d7ac43de9f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:09.205626 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779771534.20349, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:09.205823 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:09.205941 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Stopped (Lifecycle Event)
May 26 04:59:09.222894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Found WWN 3300000007d246083 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:09.223182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:09.223393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== connect_volume: return (9237ms) {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-7', 'multipath_id': '3300000007d246083'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:09.223511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-7', 'multipath_id': '3300000007d246083'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:09.226098 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'flavor' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:09.324028 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:09.401714 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:09.436129 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:09.436386 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771549.4362295, 6b3962c4-d73d-4c08-a0bf-751265f8b607 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:09.437143 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] VM Started (Lifecycle Event)
May 26 04:59:09.542325 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Took 14.31 seconds to build instance.
May 26 04:59:09.708380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4e0e2307-fa02-4bb3-9058-f00988f438b8 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:09.726943 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:09.729540 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attempting to attach volume 575b9d98-8caa-44b9-814a-7e29ce2fc18b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 04:59:09.730448 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] attach device xml: <disk type="block" device="disk">
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:   <alias name="ua-575b9d98-8caa-44b9-814a-7e29ce2fc18b"/>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:   <serial>575b9d98-8caa-44b9-814a-7e29ce2fc18b</serial>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:09.730448 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 04:59:09.922339 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updated VIF entry in instance network info cache for port 25738872-72e4-45c4-a2e9-343e565dcf1b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:09.925623 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [{"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:09.941191 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:09.943673 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:10.021804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e1797871-f011-4a69-86fa-06f522cff725 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.551s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.045641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fc7750a2-70d1-473d-b5bf-b3eef454aef4 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.816s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.057822 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:10.058543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:10.058885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:10.059072 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.059294 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No event matching network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e in dict_keys([('network-vif-plugged', '203a11b7-726d-4b89-a085-71ee7033cf4b')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:10.059496 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e for instance with vm_state building and task_state spawning.
May 26 04:59:10.059736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:10.059884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:10.060092 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:10.060261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.060487 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Processing event network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:10.060666 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:10.060857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:10.061044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:10.061289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.061496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:10.061676 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9ffdc5e2-5e1f-45bd-9cfa-1518a1f7f7ca req-774c3b8c-9d8c-40fa-ba1c-95cfe8445f5b service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received unexpected event network-vif-plugged-203a11b7-726d-4b89-a085-71ee7033cf4b for instance with vm_state building and task_state spawning.
May 26 04:59:10.062756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance event wait completed in 2 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:10.066449 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:10.068958 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance spawned successfully.
May 26 04:59:10.069392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:10.329017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.426230 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Releasing lock "refresh_cache-595593d5-7b8b-4177-a99e-d29c31010070" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:10.426478 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-changed-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:10.426608 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Refreshing instance network info cache due to event network-changed-4b55beac-defe-45b7-8158-98dd534cbe0d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:10.426784 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Acquiring lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:10.426876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Acquired lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:10.426986 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Refreshing network info cache for port 4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:10.450573 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771550.4500046, 6b3962c4-d73d-4c08-a0bf-751265f8b607 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:10.450776 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] VM Paused (Lifecycle Event)
May 26 04:59:10.455587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] volume_snapshot_create: create_info: {'snapshot_id': 'a40a038e-b634-4b0c-b45c-ef59c6807662', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98319) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3769}}
May 26 04:59:10.459708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] snap xml: <domainsnapshot>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:   <disks>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:     <disk name="/dev/dm-3" snapshot="external" type="file">
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:       <source file="/dev/new_file"/>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:     <disk name="vda" snapshot="no"/>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:     <disk name="hda" snapshot="no"/>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:   </disks>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]: </domainsnapshot>
May 26 04:59:10.459708 np0000001388 nova-compute[98319]:  {{(pid=98319) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3710}}
May 26 04:59:10.460017 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] Lazy-loading 'system_metadata' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:10.541346 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d3d50a60-7ece-446e-8c61-e7d49a58558f tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] volume_snapshot_delete: delete_info: {'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4'} {{(pid=98319) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3877}}
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-d3d50a60-7ece-446e-8c61-e7d49a58558f tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Traceback (most recent call last):
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     self._volume_snapshot_delete(context, instance, volume_id,
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     if delete_info['type'] != 'qcow2':
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]        ~~~~~~~~~~~^^^^^^^^
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] KeyError: 'type'
May 26 04:59:10.548468 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] 
May 26 04:59:10.578989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.579160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.579591 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.579979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.580156 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.580779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-d3d50a60-7ece-446e-8c61-e7d49a58558f tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver        ~~~~~~~~~~~^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver KeyError: 'type'
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d84cb40c-e0a1-4d17-94fe-60f611e92308)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
May 26 04:59:10.601560 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server [None req-d3d50a60-7ece-446e-8c61-e7d49a58558f tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] Exception during message handling: KeyError: 'type'
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4053, in volume_snapshot_delete
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4050, in volume_snapshot_delete
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3880, in _volume_snapshot_delete
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server        ~~~~~~~~~~~^^^^^^^^
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server KeyError: 'type'
May 26 04:59:10.624469 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server 
May 26 04:59:10.817915 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:10.817915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:10.820106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:10.820491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:10.820735 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:10.820938 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a794999f-ac63-4403-a18c-ba4dccc91aa6 req-7a1d14de-fc9e-4d53-a808-43d428c567c6 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state rescued and task_state unrescuing.
May 26 04:59:10.929552 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:10.960617 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:10.967504 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771550.96694, 6b3962c4-d73d-4c08-a0bf-751265f8b607 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:10.967657 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] VM Resumed (Lifecycle Event)
May 26 04:59:10.971827 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Skipping quiescing instance: QEMU guest agent is not enabled.
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Traceback (most recent call last):
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:10.989531 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] 
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Traceback (most recent call last):
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     self._volume_snapshot_create(context, instance, guest,
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c]     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:10.990689 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] 
May 26 04:59:11.025122 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Unrescuing
May 26 04:59:11.025122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:11.025122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:11.025122 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a40a038e-b634-4b0c-b45c-ef59c6807662 could not be found.
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a40a038e-b634-4b0c-b45c-ef59c6807662 could not be found. (HTTP 404) (Request-ID: req-9497f568-5f3d-49ca-803e-6c12c1dec69c)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3609, in _volume_snapshot_update_status
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a40a038e-b634-4b0c-b45c-ef59c6807662 could not be found.
May 26 04:59:11.034181 np0000001388 nova-compute[98319]: ERROR nova.virt.libvirt.driver 
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server [None req-61f4cd52-f77e-41d4-b93f-503f14389e35 tempest-VolumesAssistedSnapshotsTest-2013963540 tempest-VolumesAssistedSnapshotsTest-2013963540-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3790, in volume_snapshot_create
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 271, in __exit__
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self.force_reraise()
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 233, in force_reraise
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise self.value
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3787, in volume_snapshot_create
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3737, in _volume_snapshot_create
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
May 26 04:59:11.037271 np0000001388 nova-compute[98319]: ERROR oslo_messaging.rpc.server 
May 26 04:59:11.089533 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Took 29.27 seconds to spawn the instance on the hypervisor.
May 26 04:59:11.089900 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:11.342879 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:11.405806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:11.406015 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:11.406151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:11.406303 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No VIF found with MAC fa:16:3e:31:f0:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:11.446070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:11.446823 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:11.463244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:11.464054 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:11.474294 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:11.477588 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:11.529325 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:11.534645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updated VIF entry in instance network info cache for port 4b55beac-defe-45b7-8158-98dd534cbe0d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:11.534935 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updating instance_info_cache with network_info: [{"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:11.566998 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:11.604382 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Took 45.70 seconds to build instance.
May 26 04:59:11.897868 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:11.951723 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:59:11.959755 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:11.959934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:11.960118 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Attaching volume 3c16bb97-ab34-4618-a650-72a627372160 to /dev/vdb
May 26 04:59:11.966995 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Detaching volume 6b36577d-8405-4591-b8a8-76d1aa4156d4
May 26 04:59:11.987186 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771551.9867833, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:11.987625 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Resumed (Lifecycle Event)
May 26 04:59:12.034059 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:12.038257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-282da36f-1ede-48a1-b2b0-2714d528a2e4 req-e16feb0c-0dac-4a14-946e-53b7475e7217 service nova] Releasing lock "refresh_cache-7e0085ac-d343-4e32-85db-8489cbf3a677" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:12.039541 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Attempting to driver detach volume 6b36577d-8405-4591-b8a8-76d1aa4156d4 from mountpoint /dev/vdb
May 26 04:59:12.047987 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Found disk vdb by alias ua-6b36577d-8405-4591-b8a8-76d1aa4156d4 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:12.049235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Found disk vdb by alias ua-6b36577d-8405-4591-b8a8-76d1aa4156d4 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:12.049344 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Attempting to detach device vdb from instance ffc28a48-a02b-4225-9a27-6c0b4f33101c from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 04:59:12.049587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] detach device xml: <disk type="block" device="disk">
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <alias name="ua-6b36577d-8405-4591-b8a8-76d1aa4156d4"/>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <serial>6b36577d-8405-4591-b8a8-76d1aa4156d4</serial>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:12.049587 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:12.052739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:59:12.059887 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Successfully detached device vdb from instance ffc28a48-a02b-4225-9a27-6c0b4f33101c from the persistent domain config.
May 26 04:59:12.060400 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] (1/8): Attempting to detach device vdb with device alias ua-6b36577d-8405-4591-b8a8-76d1aa4156d4 from instance ffc28a48-a02b-4225-9a27-6c0b4f33101c from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 04:59:12.060400 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] detach device xml: <disk type="block" device="disk">
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <alias name="ua-6b36577d-8405-4591-b8a8-76d1aa4156d4"/>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <serial>6b36577d-8405-4591-b8a8-76d1aa4156d4</serial>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:12.060400 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:12.080229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:12.106940 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [{"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:12.110690 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.214s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:12.114980 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:12.115239 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:59:12.122512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:59:12.124063 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe83:c2ac', 'fe80::8881:9bff:fe38:9afe', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe55:64fe', 'fe80::d4b4:38ff:fe98:dac2', 'fe80::fc16:3eff:fe4c:5822', 'fe80::fc16:3eff:fed7:218f', 'fe80::fc16:3eff:fe03:14a3', 'fe80::fc16:3eff:feb8:922f', 'fe80::58aa:a8ff:fe4a:40f2', 'fe80::fc16:3eff:fe10:61df', 'fe80::fc16:3eff:fe8b:ae47', 'fe80::fc16:3eff:fefa:c9fe', 'fe80::2c4f:25ff:fe37:4722', 'fe80::8458:25ff:fea5:58d3', 'fe80::fc16:3eff:feda:fbd7'] 
May 26 04:59:12.124274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:59:12.124398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:59:12.124674 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:12.124926 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating existing volume attachment record: ad1aa783-101f-4557-833b-04ae2993341a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:59:12.493414 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:12.499406 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:12.504305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:12.504600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:12.509846 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:12.510038 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Claim successful on node np0000001388
May 26 04:59:12.569503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-6b36577d-8405-4591-b8a8-76d1aa4156d4 for instance ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 04:59:12.612782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-255cce8a-f08d-4c8e-b498-4b0ef153fc5b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:12.613475 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'flavor' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:12.678568 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:59:12.678997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:12.679205 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:12.679689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:12.679954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:12.691640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:12.692347 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:12.693052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:12.693289 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:12.693743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:12.693967 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:12.706814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:12.706814 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:12.708550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:12.708550 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:12.720020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160] added
May 26 04:59:12.720020 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:12.720020 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:12.720020 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:12.720020 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:12.720020 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:12.720020 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:12.720436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:12.720436 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:12.720571 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:12.725044 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160] added
May 26 04:59:12.725044 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:12.725044 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:12.725044 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:12.725044 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:12.725044 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:12.725044 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:12.725393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:12.725511 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:12.725671 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:12.972421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-46c74528-437a-4638-aaff-f235783c6d6c tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.735s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:13.002952 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 04:59:13.005491 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771553.003102, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:13.005709 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Started (Lifecycle Event)
May 26 04:59:13.149494 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.177008 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.382428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.390546 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.422275 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.474870 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.508068 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance destroyed successfully.
May 26 04:59:13.510079 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'numa_topology' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:13.517131 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.521419 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:13.530489 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771553.5299928, 0d47d0b8-fefe-4218-9bd0-08c318e7484a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:13.530663 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] VM Resumed (Lifecycle Event)
May 26 04:59:13.540020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.550210 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:13.551258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:13.551473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:13.551934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:13.551934 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:13.551934 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-bb6042fa-2344-4067-9f74-b7b7fa859e01 req-a377b671-7e69-4dc6-8e51-cd5c97b45feb service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state rescued and task_state unrescuing.
May 26 04:59:13.720782 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.721677 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:13.726549 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-changed-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:13.726725 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing instance network info cache due to event network-changed-a7ef8ccb-c585-4d52-821d-9625a7566f42. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:13.728422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] Acquiring lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:13.730044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.730267 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:13.736703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] Acquired lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:13.737131 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Refreshing network info cache for port a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:13.743873 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:13.743873 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:13.751329 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:13.751329 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.759009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.765600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.783458 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.783859 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.792385 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.792859 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:13.854601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.40.100,3260]
May 26 04:59:13.854601 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.40.100,3260] successful.
May 26 04:59:13.854601 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.863436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.50.100,3260]
May 26 04:59:13.863436 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.50.100,3260] successful.
May 26 04:59:13.863436 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.872066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.886826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.902059 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.902645 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:13.903912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:13.904547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.907119 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:13.908667 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:13.908667 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:13.909454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:13.909829 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] HCTL ('19', '-', '-', 0) found on session 19 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:13.909998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:13.912282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] HCTL ('20', '-', '-', 0) found on session 20 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:13.912502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:13.942696 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching for a device in session 19 and hctl ['19', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:13.942696 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:13.944948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching for a device in session 20 and hctl ['20', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:13.945136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:13.966693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:13.976469 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.018964 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<255cce8a-f08d-4c8e-b498-4b0ef153fc5b> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:59:14.033596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:14.048898 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:14.241550 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:14.279663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:14.279934 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:14.522191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.554089 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771554.552397, ffc28a48-a02b-4225-9a27-6c0b4f33101c => ua-6b36577d-8405-4591-b8a8-76d1aa4156d4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 04:59:14.554839 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.555584 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99942443100008 future=<Future at 0x7d7aeda568d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:14.557434 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997722027000009 future=<Future at 0x7d7aeda568d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:14.557731 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997331605999989 future=<Future at 0x7d7aeda568d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:14.557812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.564452 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Successfully detached device vdb from instance ffc28a48-a02b-4225-9a27-6c0b4f33101c from the live domain config.
May 26 04:59:14.565694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 04:59:14.566147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:14.566256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:14.690072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.696916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:14.722213 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:14.747900 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.751217 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:14.784157 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:14.962898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updated VIF entry in instance network info cache for port a7ef8ccb-c585-4d52-821d-9625a7566f42. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:14.963522 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:15.299108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.794s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.299604 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:59:15.466423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e07cfd0b-81c4-42f0-b717-849a50e5723b req-f3eb5a4e-3c86-43ee-b267-7b18fbbc9a9a service nova] Releasing lock "refresh_cache-0d47d0b8-fefe-4218-9bd0-08c318e7484a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:15.489701 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 255cce8a-f08d-4c8e-b498-4b0ef153fc5b due to new event <LifecycleEvent: 1779771555.4893026, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 04:59:15.489946 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771555.4893026, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:15.490191 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Resumed (Lifecycle Event)
May 26 04:59:15.492919 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d5540945-bcca-46ae-bec2-91f885d4866a tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:15.633527 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.633981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.633981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.634186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.634388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.634622 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.634835 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.635002 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.635219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.635648 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.635811 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.636005 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.636171 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.636382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.636722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.636722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.637077 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.637077 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.637166 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.637464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.637592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.637724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.637852 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.637994 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.638175 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.638434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.638578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.638720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.638896 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.639551 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.639708 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.639892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.640056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.640224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.640396 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.640558 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.640710 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:15.640867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:15.641098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:15.641149 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:15.641337 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:15.641480 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76712350-d642-4b79-b746-ea22267d8cad req-d63d8c18-7dc4-4daf-97c4-15a62e5e6a18 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received unexpected event network-vif-plugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with vm_state active and task_state None.
May 26 04:59:15.722918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found WWN 3300000001c9041c1 for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:15.723278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:15.723503 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '3300000001c9041c1', 'path': '/dev/dm-8', 'multipath_id': '3300000001c9041c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:15.723659 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001c9041c1', 'path': '/dev/dm-8', 'multipath_id': '3300000001c9041c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:15.727713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:15.728081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6b36577d-8405-4591-b8a8-76d1aa4156d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 04:59:15.728244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 04:59:15.734419 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:15.774657 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [15] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [16] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:15.775127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:15.775127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', '15'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 04:59:15.775722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', '15')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:15.776843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4', '16')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:15.778178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4589a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 04:59:15.781531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Removing multipathed devices sdk, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 04:59:15.781848 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Flush multipath device 330000000ca27e8b1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 04:59:15.806116 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:59:15.807745 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:59:15.811266 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:15.811266 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:15.811266 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:15.853055 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:15.887506 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1e56d19720934fccb862b18021b97675', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fec238eac0a44f19ba4295e8c72b582', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:59:15.898541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 04:59:15.898727 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 04:59:15.900576 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 04:59:15.925519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 04:59:15.925519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 04:59:15.931523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:15.971224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.40.100,3260]
May 26 04:59:15.971224 np0000001388 nova-compute[98319]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.40.100,3260] successful.
May 26 04:59:15.971224 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:15.993263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:15.993986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:15.995163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:16.010645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:16.058633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.50.100,3260]
May 26 04:59:16.058633 np0000001388 nova-compute[98319]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-6b36577d-8405-4591-b8a8-76d1aa4156d4, portal: 192.168.50.100,3260] successful.
May 26 04:59:16.058633 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:16.094503 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:16.094786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:16.094990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] <== disconnect_volume: return (1528ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:16.095046 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 04:59:16.241943 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Attempting to attach volume 3c16bb97-ab34-4618-a650-72a627372160 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 04:59:16.243147 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] attach device xml: <disk type="block" device="disk">
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:16.243147 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 04:59:16.252026 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 26 04:59:16.311384 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:59:16.499731 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771556.4994557, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:16.499875 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Started (Lifecycle Event)
May 26 04:59:16.534411 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Successfully created port: 1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:59:16.570995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:16.664399 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lazy-loading 'flavor' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:16.823054 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:59:16.828499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:16.828701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:17.004486 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:17.006247 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:17.153690 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Successfully updated port: 1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:59:17.337507 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:17.337989 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Claim successful on node np0000001388
May 26 04:59:17.573102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:17.573409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:17.655526 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:17.655946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquired lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:17.655946 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:17.670322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fcd8476c-2302-4d2c-ac40-83c2e86bfb80 tempest-VolumesAssistedSnapshotsTest-1866912128 tempest-VolumesAssistedSnapshotsTest-1866912128-project-admin] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.206s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:17.730499 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-changed-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:17.734252 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Refreshing instance network info cache due to event network-changed-1943f31e-9f0c-4248-ae64-be3c6d978c5c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:17.734485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] Acquiring lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:17.832853 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:17.834953 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:17.834953 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Creating image(s)
May 26 04:59:17.835899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:17.835899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:17.836530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:17.838379 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:17.840988 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:17.842927 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:17.863380 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating resource usage from migration f403b878-081a-4148-97f0-fd3b4405a983
May 26 04:59:17.939469 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:17.939924 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:17.940626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:17.941735 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:17.944624 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:17.945252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:17.972823 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:17.973103 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:17.973259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:17.973435 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No VIF found with MAC fa:16:3e:27:0c:d3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:18.039993 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:18.040885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:18.076373 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:59:18.081498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk 1073741824" returned: 0 in 0.041s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:18.081974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.141s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:18.082402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:18.184254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:18.184723 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Checking if we can resize image /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:18.185005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:18.282175 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:18.285084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:18.285768 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Cannot resize image /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:18.286258 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:59:18.286480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Ensure instance console log exists: /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:18.287220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:18.287597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:18.287776 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:18.428328 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:18.506667 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:18.664428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:18.687111 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Updating instance_info_cache with network_info: [{"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:18.703858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:18.704301 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:19.190172 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Releasing lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:19.190587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Instance network_info: |[{"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:19.194221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] Acquired lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:19.194221 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Refreshing network info cache for port 1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:19.194221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Start _get_guest_xml network_info=[{"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:19.196000 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:19.200621 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServersNegativeTestJSON-server-1040885283', uuid='84b0e38d-d94f-442c-b26c-5adfb9ad5bc0'), owner=OwnerMeta(userid='1e56d19720934fccb862b18021b97675', username='tempest-ServersNegativeTestJSON-1974443015-project-member', projectid='6fec238eac0a44f19ba4295e8c72b582', projectname='tempest-ServersNegativeTestJSON-1974443015'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771559.1972394) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:19.201051 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:19.201495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:19.202129 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:19.202552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:19.204865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:19.214847 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:19.241442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:19.241642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:19.242122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:19.242122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:19.242122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:19.247402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1040885283',display_name='tempest-ServersNegativeTestJSON-server-1040885283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-1040885283',id=11,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-xphp367x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:17Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=84b0e38d-d94f-442c-b26c-5adfb9ad5bc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:19.247660 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:19.248455 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:19.249270 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lazy-loading 'pci_devices' on Instance uuid 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:19.253826 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Terminating instance
May 26 04:59:19.296687 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.345865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:19.346089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:19.533649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6b3cb500-b785-486d-bf16-ef1df7cea18f tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.574s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:19.695496 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:19.737132 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.908s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:19.740481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.073s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:19.740769 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Migrating
May 26 04:59:19.741106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:19.741274 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:19.745656 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:19.748001 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Claim successful on node np0000001388
May 26 04:59:19.758244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <uuid>84b0e38d-d94f-442c-b26c-5adfb9ad5bc0</uuid>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <name>instance-0000000b</name>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServersNegativeTestJSON-server-1040885283</nova:name>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:19</nova:creationTime>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:user uuid="1e56d19720934fccb862b18021b97675">tempest-ServersNegativeTestJSON-1974443015-project-member</nova:user>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:project uuid="6fec238eac0a44f19ba4295e8c72b582">tempest-ServersNegativeTestJSON-1974443015</nova:project>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         <nova:port uuid="1943f31e-9f0c-4248-ae64-be3c6d978c5c">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="serial">84b0e38d-d94f-442c-b26c-5adfb9ad5bc0</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="uuid">84b0e38d-d94f-442c-b26c-5adfb9ad5bc0</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.config"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:08:89:6a"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <target dev="tap1943f31e-9f"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/console.log" append="off"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:19.758244 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Preparing to wait for external event network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1040885283',display_name='tempest-ServersNegativeTestJSON-server-1040885283',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-1040885283',id=11,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-xphp367x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:17Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=84b0e38d-d94f-442c-b26c-5adfb9ad5bc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:19.761108 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:19.761765 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:19.765220 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:19.765220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:59:19.765220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.765220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:19.765220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:19.765895 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.766134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f46c2aa-02a0-5b39-aabf-8186c875a67d', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:19.767273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.767993 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:19.768639 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.783054 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.783357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1943f31e-9f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:19.783744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1943f31e-9f, col_values=(('qos', UUID('9d410f40-9e9f-482b-821d-7e252e4907d1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:19.783914 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1943f31e-9f, col_values=(('external_ids', {'iface-id': '1943f31e-9f0c-4248-ae64-be3c6d978c5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:89:6a', 'vm-uuid': '84b0e38d-d94f-442c-b26c-5adfb9ad5bc0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:19.784912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.786323 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:19.792790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.824023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.829603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.850601 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:19.853318 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:19.857057 np0000001388 nova-compute[98319]: INFO os_vif [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f')
May 26 04:59:19.870513 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.140173 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999601963000032 future=<Future at 0x7d7aeda64b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:20.145238 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Instance destroyed successfully.
May 26 04:59:20.145789 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lazy-loading 'resources' on Instance uuid ffc28a48-a02b-4225-9a27-6c0b4f33101c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:20.161298 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:20.246360 np0000001388 nova-compute[98319]: INFO nova.compute.rpcapi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72
May 26 04:59:20.246872 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:20.247084 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 04:59:20.340346 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:20.341586 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:20.341586 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:20.341810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:20.341969 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] No waiting events found dispatching network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:20.342085 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-887e7b2a-1173-4670-9d7f-0f5f913f9942 req-8e335d0e-2e05-4996-bbcf-95a4a7f25a43 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:20.367420 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Updated VIF entry in instance network info cache for port 1943f31e-9f0c-4248-ae64-be3c6d978c5c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:20.367420 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Updating instance_info_cache with network_info: [{"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:20.650973 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-276036843',display_name='tempest-VolumesAssistedSnapshotsTest-server-276036843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesassistedsnapshotstest-server-276036843',id=4,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5n4PWmJlNOusskWP6zjb0sRw29wLNUVZdIGtGrCiNlhBWGEB5iPXMYL/ZPBny4hR8bOWLBFn1PEjw6T3uuRx6a/jdmOWXLrsz+lCdZDxcF5ohjHncom0pQi0ItN+tICA==',key_name='tempest-keypair-1031968398',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:16Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05f3a65784ad474cbbbf803346ae848c',ramdisk_id='',reservation_id='r-66dsq433',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-899536495',owner_user_name='tempest-VolumesAssistedSnapshotsTest-899536495-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1b2f1c00cd8407db8523182fc86aa68',uuid=ffc28a48-a02b-4225-9a27-6c0b4f33101c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:20.650973 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converting VIF {"id": "9f87b34a-27db-4487-be94-b68c78061b43", "address": "fa:16:3e:83:c2:ac", "network": {"id": "e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1055274727-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "05f3a65784ad474cbbbf803346ae848c", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f87b34a-27", "ovs_interfaceid": "9f87b34a-27db-4487-be94-b68c78061b43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:20.651990 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:20.652536 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:20.654719 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.654971 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9f87b34a-27, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:20.656466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.657366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:20.663722 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.664857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.665032 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=000934f7-7894-46c1-83fb-198ef74f919b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:20.665611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.666133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:20.674231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:20.677790 np0000001388 nova-compute[98319]: INFO os_vif [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:c2:ac,bridge_name='br-int',has_traffic_filtering=True,id=9f87b34a-27db-4487-be94-b68c78061b43,network=Network(e7a9e8ab-2fee-4f09-980d-23ba24f8b3eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f87b34a-27')
May 26 04:59:20.678248 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Deleting instance files /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c_del
May 26 04:59:20.678912 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Deletion of /opt/stack/data/nova/instances/ffc28a48-a02b-4225-9a27-6c0b4f33101c_del complete
May 26 04:59:20.779441 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:20.780026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:20.780517 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:20.862586 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:20.876801 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a59ef52-bb11-49cd-9802-2b263d7a7b5e req-49d195f2-552f-4ad4-ba85-5db3a0995277 service nova] Releasing lock "refresh_cache-84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:21.187253 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Took 1.42 seconds to destroy the instance on the hypervisor.
May 26 04:59:21.188196 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:59:21.188874 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:59:21.189055 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:59:21.189804 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:21.283754 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:21.344333 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:21.393681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:21.393910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:21.394090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] No VIF found with MAC fa:16:3e:08:89:6a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:21.394840 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Using config drive
May 26 04:59:21.573692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:21.644899 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:21.646216 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:21.779500 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:21.903679 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:21.941248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9fdbd13c-ae10-4a39-8569-0a98b2135a11 req-b73c0060-0065-4017-b3ed-9cfeaca9ab36 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-deleted-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:21.941248 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-9fdbd13c-ae10-4a39-8569-0a98b2135a11 req-b73c0060-0065-4017-b3ed-9cfeaca9ab36 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Neutron deleted interface 9f87b34a-27db-4487-be94-b68c78061b43; detaching it from the instance and deleting it from the info cache
May 26 04:59:21.941248 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9fdbd13c-ae10-4a39-8569-0a98b2135a11 req-b73c0060-0065-4017-b3ed-9cfeaca9ab36 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:21.957551 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:22.002114 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:22.002296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:22.002492 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Attaching volume 3c16bb97-ab34-4618-a650-72a627372160 to /dev/vdb
May 26 04:59:22.048219 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Creating config drive at /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.config
May 26 04:59:22.049137 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwfu_pkcx {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:22.064551 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:22.076520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:59:22.094243 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwfu_pkcx" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:22.100406 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:22.133082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:22.134510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:59:22.146839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:59:22.152597 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::fc16:3eff:fe31:f0b0', 'fe80::9810:d8ff:fee9:d834', 'fe80::6c5d:43ff:fe8d:2b5e', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe55:64fe', 'fe80::d4b4:38ff:fe98:dac2', 'fe80::fc16:3eff:fe4c:5822', 'fe80::fc16:3eff:fed7:218f', 'fe80::fc16:3eff:fe03:14a3', 'fe80::fc16:3eff:feb8:922f', 'fe80::58aa:a8ff:fe4a:40f2', 'fe80::fc16:3eff:fe10:61df', 'fe80::fc16:3eff:fe8b:ae47', 'fe80::fc16:3eff:fefa:c9fe', 'fe80::2c4f:25ff:fe37:4722', 'fe80::8458:25ff:fea5:58d3', 'fe80::fc16:3eff:feda:fbd7'] 
May 26 04:59:22.152597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:59:22.152597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:59:22.152597 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:22.152597 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updating existing volume attachment record: 9a512c25-22c3-4692-8dcb-7bdcafe1d5cd {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:59:22.154547 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:22.380379 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:22.445708 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:22.445968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] Acquiring lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:22.446177 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:22.446371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:22.446537 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] No waiting events found dispatching network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:22.446679 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-87eb2f3b-dab3-4b5b-907b-68a5383111f7 req-d77c3ddd-feff-4f89-ae2f-76aee82dbd47 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Received event network-vif-unplugged-9f87b34a-27db-4487-be94-b68c78061b43 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:22.451541 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9fdbd13c-ae10-4a39-8569-0a98b2135a11 req-b73c0060-0065-4017-b3ed-9cfeaca9ab36 service nova] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Detach interface failed, port_id=9f87b34a-27db-4487-be94-b68c78061b43, reason: Instance ffc28a48-a02b-4225-9a27-6c0b4f33101c could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 04:59:22.459812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:22.581643 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.609214 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.611564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.667295 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.930s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:22.668089 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:59:22.673333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.723891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:59:22.724407 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:22.724664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:22.725805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:22.726101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:22.727797 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.744671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:22.746738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:22.747219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:22.747463 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:22.747764 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:22.747914 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:22.766066 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:22.766066 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:22.775865 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:22.775865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:22.784262 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:22.790942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:22.792362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.808250 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:22.808857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:22.808857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:22.809674 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] HCTL ('20', '0', '0', 0) found on session 20 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:22.809830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.821520 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:22.821907 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:22.822450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching for a device in session 20 and hctl ('20', '0', '0', 0) yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:22.823944 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:22.825355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.077s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:22.825557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:22.826497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] HCTL ('19', '0', '0', 0) found on session 19 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:22.826653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:22.836764 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Searching for a device in session 19 and hctl ('19', '0', '0', 0) yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:22.837008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:22.882767 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Took 1.69 seconds to deallocate network for instance.
May 26 04:59:23.179819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:59:23.179819 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:59:23.179819 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:23.179819 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:23.254100 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d25c63261bb45f1bc8ab1e39768c377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f7e0bdf71e47a9b6de4e03f880f492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:59:23.399329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:23.399329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:23.454644 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771563.4542925, 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:23.454900 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] VM Started (Lifecycle Event)
May 26 04:59:23.680703 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:59:23.746854 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:23.761379 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Successfully created port: 0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:59:23.961222 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:23.963265 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771563.9630046, 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:23.963387 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] VM Paused (Lifecycle Event)
May 26 04:59:23.981303 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 26 04:59:24.006766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.015562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.032897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.067403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.138559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:24.138810 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:24.187665 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:59:24.296603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.306143 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.331639 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance destroyed successfully.
May 26 04:59:24.333371 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:15Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:24.333371 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:24.333913 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:24.334118 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:24.336376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.336626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1df6515-d2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:24.337724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.338686 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:24.340529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.340705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.340861 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55c48519-5cb6-41c9-87a1-1a84698b4398) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:24.342106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.342106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:24.343830 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:24.348081 np0000001388 nova-compute[98319]: INFO os_vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 04:59:24.349139 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 04:59:24.349593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:24.349865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:24.465779 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:24.468693 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:24.576554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:24.576854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:24.577500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:24.577759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:24.577928 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:24.578097 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9cfc7117-f9a4-4733-a586-89dcdcd0734a req-3b8d6abf-5396-4763-8194-d7fe6be11309 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state active and task_state resize_migrating.
May 26 04:59:24.636709 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Successfully updated port: 0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:59:24.641719 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:24.742632 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:24.744163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:24.745321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:24.745321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:24.745321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Processing event network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:24.745321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:24.745321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:24.745529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:24.745659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:24.745769 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] No waiting events found dispatching network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:24.745875 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-077f9e99-7763-448d-b02c-238c8214e4d4 req-d37eb52a-d34a-4b33-8446-f80061032cd1 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received unexpected event network-vif-plugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c for instance with vm_state building and task_state spawning.
May 26 04:59:24.746625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:24.752099 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:24.753349 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Instance spawned successfully.
May 26 04:59:24.753673 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:24.772981 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found WWN 3300000001c9041c1 for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:24.773394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:24.773681 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] <== connect_volume: return (2048ms) {'type': 'block', 'scsi_wwn': '3300000001c9041c1', 'path': '/dev/dm-8', 'multipath_id': '3300000001c9041c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:24.773974 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001c9041c1', 'path': '/dev/dm-8', 'multipath_id': '3300000001c9041c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:24.775532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.425s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:24.776484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 04:59:24.777105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 04:59:24.780507 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:24.816913 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:24.817362 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:24.817936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '18'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 04:59:24.817936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '18')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:24.819230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '17')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:24.820553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43e05e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 04:59:24.821071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Removing multipathed devices sdl, sdm {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 04:59:24.821418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flush multipath device 3300000007d246083 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 04:59:24.852397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:24.886998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:24.940021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 04:59:24.940381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 04:59:24.942476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 04:59:24.961095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 04:59:24.961349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 04:59:24.972365 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:24.972778 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999804954999945 future=<Future at 0x7d7aa45dc8c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:24.973010 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771564.972824, 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:24.973281 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] VM Resumed (Lifecycle Event)
May 26 04:59:24.979449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.027591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 04:59:25.027591 np0000001388 nova-compute[98319]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 04:59:25.027591 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.051602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.063438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.099746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 04:59:25.099746 np0000001388 nova-compute[98319]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 04:59:25.099746 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.125779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:25.126605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:25.126605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== disconnect_volume: return (776ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:25.126605 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 04:59:25.138367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.155314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:25.155763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:25.156305 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:25.162750 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.760s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:25.202302 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:25.204287 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:25.204287 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Creating image(s)
May 26 04:59:25.204709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:25.205214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:25.207594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:25.208665 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:25.211863 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:25.213242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.236148 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.239244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.246870 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Deleted allocations for instance ffc28a48-a02b-4225-9a27-6c0b4f33101c
May 26 04:59:25.282285 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.282285 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.283006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.283006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.284536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.284536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:25.289797 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Attempting to attach volume 3c16bb97-ab34-4618-a650-72a627372160 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 04:59:25.291150 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] attach device xml: <disk type="block" device="disk">
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:25.291150 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 04:59:25.302800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.303294 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:25.303832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:25.304333 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:25.308110 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:25.308539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.339178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.339696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:25.341535 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.401987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.402594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.452910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk 1073741824" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.453580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:25.454167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.472675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk" returned: 0 in 0.132s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.474444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk.config /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.494112 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:25.500492 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:25.512957 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk.config /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config" returned: 0 in 0.038s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.513874 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk.info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.553962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "cp -r /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_resize/disk.info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" returned: 0 in 0.040s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.569056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.569315 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:25.569692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:25.664089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:25.664994 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Cannot resize image /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:25.665670 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:59:25.666023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Ensure instance console log exists: /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:25.666574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:25.666637 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:25.666830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:25.794799 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Took 7.96 seconds to spawn the instance on the hypervisor.
May 26 04:59:25.795240 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:25.798348 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:26.004377 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:26.048029 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:26.277470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12721d2a-f4f9-472c-8415-3783cd587e96 tempest-VolumesAssistedSnapshotsTest-899536495 tempest-VolumesAssistedSnapshotsTest-899536495-project-member] Lock "ffc28a48-a02b-4225-9a27-6c0b4f33101c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:26.309744 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Took 13.85 seconds to build instance.
May 26 04:59:26.375300 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.375764 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.375968 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.376656 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.377093 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.377093 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.377297 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.377541 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.377691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 04:59:26.377948 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 04:59:26.541898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Updating instance_info_cache with network_info: [{"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:26.578335 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:26.709719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:26.710229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:26.710409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:26.710757 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:26.710757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:26.710847 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state active and task_state resize_migrating.
May 26 04:59:26.711621 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-changed-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:26.711621 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Refreshing instance network info cache due to event network-changed-0b60cfde-3c4e-40f1-959a-62e7c65a18e3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:26.711621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Acquiring lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:26.757930 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:26.758370 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:26.812905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a600899-b3c1-427c-8462-508300b3cfd1 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.366s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:26.852098 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Port a1df6515-d249-4964-8dc0-e810a2fa8446 binding to destination host np0000001388 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 26 04:59:26.884685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:26.884685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:26.884983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:26.884983 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 04:59:26.987510 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:26.987627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:26.987726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:26.987818 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] No VIF found with MAC fa:16:3e:5f:78:a1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:27.044691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:27.045139 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Instance network_info: |[{"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:27.045720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Acquired lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:27.049546 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Refreshing network info cache for port 0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:27.051304 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Start _get_guest_xml network_info=[{"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:27.055832 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:27.057287 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1227335800', uuid='e92b6ba1-ed68-40ff-b800-059778f862ac'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771567.056861) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:27.058709 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:27.059114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:27.060089 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:27.060298 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:27.061499 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:27.062208 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:27.062389 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:27.062506 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:27.062786 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:27.063563 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:27.063563 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:27.063846 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:27.063846 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:27.064473 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:27.064651 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:27.064804 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:27.082022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1227335800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1227335800',id=12,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-snpbo5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:24Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=e92b6ba1-ed68-40ff-b800-059778f862ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:27.082492 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:27.083123 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:27.084044 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid e92b6ba1-ed68-40ff-b800-059778f862ac {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:27.391081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.553546 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:27.587655 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <uuid>e92b6ba1-ed68-40ff-b800-059778f862ac</uuid>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <name>instance-0000000c</name>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1227335800</nova:name>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:27</nova:creationTime>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         <nova:port uuid="0b60cfde-3c4e-40f1-959a-62e7c65a18e3">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="serial">e92b6ba1-ed68-40ff-b800-059778f862ac</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="uuid">e92b6ba1-ed68-40ff-b800-059778f862ac</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.config"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:9c:4c:bb"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <target dev="tap0b60cfde-3c"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/console.log" append="off"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:27.587655 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Preparing to wait for external event network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1227335800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1227335800',id=12,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-snpbo5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:24Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=e92b6ba1-ed68-40ff-b800-059778f862ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:27.592551 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:27.593744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.594085 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:27.594434 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:27.599930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.600463 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da50b349-26d2-5ee9-bcb7-8ec47920ebf9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:27.601652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.602383 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:27.603126 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.608599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.608839 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b60cfde-3c, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:27.609305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0b60cfde-3c, col_values=(('qos', UUID('17c71704-917a-4462-ae37-ef297aa83ac8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:27.609533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0b60cfde-3c, col_values=(('external_ids', {'iface-id': '0b60cfde-3c4e-40f1-959a-62e7c65a18e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:4c:bb', 'vm-uuid': 'e92b6ba1-ed68-40ff-b800-059778f862ac'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:27.611344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.612774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:27.619399 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:27.622700 np0000001388 nova-compute[98319]: INFO os_vif [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c')
May 26 04:59:27.894774 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 04:59:27.900519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:27.900519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:27.900705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:27.900862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:27.905668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:27.910004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:27.910351 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:27.910706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:27.933225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:27.935024 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:27.935276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:27.935674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:27.935871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:27.936036 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] No event matching network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 in dict_keys([('network-vif-plugged', '0b60cfde-3c4e-40f1-959a-62e7c65a18e3')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 04:59:27.936295 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-832fe4cf-90b3-4ada-aeab-c88e2837762e req-47111f98-a739-4ba3-b87b-bac3626d61f5 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received unexpected event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 for instance with vm_state building and task_state spawning.
May 26 04:59:27.972541 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Terminating instance
May 26 04:59:28.057873 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.059131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.185403 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.185864 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.188986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.193219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.271781 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:28.292617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.294289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.411539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.412380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.418010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.481852 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:59:28.524505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:28.524505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:28.533883 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.534428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.559773 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:28.575141 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Updated VIF entry in instance network info cache for port 0b60cfde-3c4e-40f1-959a-62e7c65a18e3. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:28.576484 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Updating instance_info_cache with network_info: [{"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:28.600697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d6d26416-d9b3-4731-b77e-c46e9d1a7a16 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.598s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:28.648968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.653236 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.752177 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:28.752988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:28.754520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.757216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.768956 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:28.781693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:28.837109 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999518747000138 future=<Future at 0x7d7aed9f76b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:28.839155 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Instance destroyed successfully.
May 26 04:59:28.840449 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lazy-loading 'resources' on Instance uuid 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:28.860112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.864029 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.864029 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.864029 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:28.871299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.958638 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:28.960329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:28.963181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:28.985123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:28.986245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:28.986653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:28.986847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:28.987749 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] No waiting events found dispatching network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:28.987749 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e1829db2-42ef-483e-8be9-5ea804831627 req-63bcf12a-acf1-404a-8530-bf1eb0433d35 service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:29.071447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.075079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.087115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bd50ca2e-0289-4ac2-85d4-b5b01d533eaa req-41e0df8b-1e91-4060-aca8-df69999b47e1 service nova] Releasing lock "refresh_cache-e92b6ba1-ed68-40ff-b800-059778f862ac" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:29.150088 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:29.150256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:29.150443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:9c:4c:bb, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:29.151287 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Using config drive
May 26 04:59:29.159300 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:29.161242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:29.161612 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:29.163720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.166221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.260226 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:59:29.272717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.273081 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 04:59:29.278892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.348257 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1040885283',display_name='tempest-ServersNegativeTestJSON-server-1040885283',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-1040885283',id=11,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:25Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-xphp367x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:26Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=84b0e38d-d94f-442c-b26c-5adfb9ad5bc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:29.354223 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "address": "fa:16:3e:08:89:6a", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1943f31e-9f", "ovs_interfaceid": "1943f31e-9f0c-4248-ae64-be3c6d978c5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:29.354223 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:29.354886 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:29.357470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.357915 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1943f31e-9f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:29.361997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.363118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:29.369145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.375002 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.375242 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d410f40-9e9f-482b-821d-7e252e4907d1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:29.378245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.378975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:29.382305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.383863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.399419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.408980 np0000001388 nova-compute[98319]: INFO os_vif [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:89:6a,bridge_name='br-int',has_traffic_filtering=True,id=1943f31e-9f0c-4248-ae64-be3c6d978c5c,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1943f31e-9f')
May 26 04:59:29.417132 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Deleting instance files /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0_del
May 26 04:59:29.418665 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Deletion of /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0_del complete
May 26 04:59:29.476543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json" returned: 1 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.477582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk --force-share --output=json' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:29.479440 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000000b, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/84b0e38d-d94f-442c-b26c-5adfb9ad5bc0/disk
May 26 04:59:29.481461 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:29.482912 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.520968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.037s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:29.520968 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12592MB free_disk=74.50699234008789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 04:59:29.521156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:29.521536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:29.555570 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004799969999567111 future=<Future at 0x7d7aeda568d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:29.555691 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:29.555875 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.583877521000204 future=<Future at 0x7d7aeda64b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:29.556721 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.583049518000053 future=<Future at 0x7d7aeda64b90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:29.626737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:29.667220 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:29.672416 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:29.835969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:29.855056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:29.855288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:29.890857 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Creating config drive at /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.config
May 26 04:59:29.894734 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp0b2q6u_ {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:29.936152 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Took 1.45 seconds to destroy the instance on the hypervisor.
May 26 04:59:29.937282 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:59:29.938045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:59:29.938045 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:59:29.938401 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:29.950212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpp0b2q6u_" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:30.062629 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:30.232576 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:30.359670 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Detaching volume 3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:30.383192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fdef3f87-8598-42ac-abaa-18692bec5308 req-6eeff0a8-5dd9-4d94-aab9-f28a74d67fce service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-deleted-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:30.385360 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-fdef3f87-8598-42ac-abaa-18692bec5308 req-6eeff0a8-5dd9-4d94-aab9-f28a74d67fce service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Neutron deleted interface 1943f31e-9f0c-4248-ae64-be3c6d978c5c; detaching it from the instance and deleting it from the info cache
May 26 04:59:30.385615 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-fdef3f87-8598-42ac-abaa-18692bec5308 req-6eeff0a8-5dd9-4d94-aab9-f28a74d67fce service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:30.436512 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Attempting to driver detach volume 3c16bb97-ab34-4618-a650-72a627372160 from mountpoint /dev/vdb
May 26 04:59:30.440358 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found disk vdb by alias ua-3c16bb97-ab34-4618-a650-72a627372160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:30.441663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found disk vdb by alias ua-3c16bb97-ab34-4618-a650-72a627372160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:30.441829 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Attempting to detach device vdb from instance 7e0085ac-d343-4e32-85db-8489cbf3a677 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 04:59:30.442118 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] detach device xml: <disk type="block" device="disk">
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:30.442118 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:30.451223 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:30.456446 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully detached device vdb from instance 7e0085ac-d343-4e32-85db-8489cbf3a677 from the persistent domain config.
May 26 04:59:30.456755 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] (1/8): Attempting to detach device vdb with device alias ua-3c16bb97-ab34-4618-a650-72a627372160 from instance 7e0085ac-d343-4e32-85db-8489cbf3a677 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 04:59:30.457040 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] detach device xml: <disk type="block" device="disk">
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:30.457040 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:30.487067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.524386 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.545220 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Applying migration context for instance 8d835b9c-8a58-4b53-9235-c49e96173d32 as it has an incoming, in-progress migration f403b878-081a-4148-97f0-fd3b4405a983. Migration status is post-migrating {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 26 04:59:30.545220 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating resource usage from migration f403b878-081a-4148-97f0-fd3b4405a983
May 26 04:59:30.614224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.705876 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.707472 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.807664 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:30.821094 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:30.892422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fdef3f87-8598-42ac-abaa-18692bec5308 req-6eeff0a8-5dd9-4d94-aab9-f28a74d67fce service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Detach interface failed, port_id=1943f31e-9f0c-4248-ae64-be3c6d978c5c, reason: Instance 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 04:59:30.953276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] Acquiring lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] No waiting events found dispatching network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:31.097798 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76aee2b5-6a6a-44e2-aaa0-5015d89f5edc req-b06ad775-1d4e-4455-8df4-ad2f87f8849c service nova] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Received event network-vif-unplugged-1943f31e-9f0c-4248-ae64-be3c6d978c5c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:31.106995 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance d8186beb-e5d9-41ee-8a66-17f7921ed75c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 04:59:31.107299 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f40c13f1-a910-4f6a-b000-2baa84ce86fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107299 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 8d835b9c-8a58-4b53-9235-c49e96173d32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107299 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Migration f403b878-081a-4148-97f0-fd3b4405a983 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 26 04:59:31.107437 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 595593d5-7b8b-4177-a99e-d29c31010070 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107478 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7e0085ac-d343-4e32-85db-8489cbf3a677 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107749 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 6b3962c4-d73d-4c08-a0bf-751265f8b607 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107749 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.107749 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 23a26816-a71d-42c9-8061-d464d5058a92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.108074 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 255cce8a-f08d-4c8e-b498-4b0ef153fc5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.108074 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e92b6ba1-ed68-40ff-b800-059778f862ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.108074 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 04:59:31.108386 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 04:59:31.108533 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 04:59:29 up 31 min,  2 users,  load average: 7.97, 3.90, 1.80\n', 'num_instances': '10', 'num_vm_active': '9', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_89f7e0bdf71e47a9b6de4e03f880f492': '3', 'io_workload': '1', 'num_task_resize_migrated': '1', 'num_proj_3e44351e7dfd4870bf0073b5f95c0423': '1', 'num_proj_6324f4c1c47a4936ba1ff72bba1fe12b': '2', 'num_proj_a773253d42414a86a7ee9ed5a1939fdc': '1', 'num_proj_278ea77812db4e90a14904f104739285': '1', 'num_proj_6fec238eac0a44f19ba4295e8c72b582': '2', 'num_task_deleting': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 04:59:31.148331 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771571.1479027, 7e0085ac-d343-4e32-85db-8489cbf3a677 => ua-3c16bb97-ab34-4618-a650-72a627372160> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 04:59:31.150050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3c16bb97-ab34-4618-a650-72a627372160 for instance 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 04:59:31.154330 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully detached device vdb from instance 7e0085ac-d343-4e32-85db-8489cbf3a677 from the live domain config.
May 26 04:59:31.323218 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Took 1.39 seconds to deallocate network for instance.
May 26 04:59:31.465159 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:31.476836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:59:31.506521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:31.527158 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771571.5259812, e92b6ba1-ed68-40ff-b800-059778f862ac => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:31.527501 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] VM Started (Lifecycle Event)
May 26 04:59:31.537667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:31.537957 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:59:31.546600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:59:31.548267 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fe5f:78a1', 'fe80::d8ea:46ff:fe3e:4be1', 'fe80::fc16:3eff:fe27:cd3', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe55:64fe', 'fe80::d4b4:38ff:fe98:dac2', 'fe80::fc16:3eff:fe4c:5822', 'fe80::fc16:3eff:fed7:218f', 'fe80::fc16:3eff:fe03:14a3', 'fe80::fc16:3eff:feb8:922f', 'fe80::58aa:a8ff:fe4a:40f2', 'fe80::fc16:3eff:fe10:61df', 'fe80::fc16:3eff:fe8b:ae47', 'fe80::fc16:3eff:fefa:c9fe', 'fe80::2c4f:25ff:fe37:4722', 'fe80::8458:25ff:fea5:58d3', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb'] 
May 26 04:59:31.548529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:59:31.548529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:59:31.548802 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:31.582548 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:31.702848 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Detected multiple connections on this host for volume: 3c16bb97-ab34-4618-a650-72a627372160, skipping target disconnect.
May 26 04:59:31.830398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:31.905626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:31.905928 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:32.037914 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:32.039606 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771572.039311, e92b6ba1-ed68-40ff-b800-059778f862ac => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:32.039936 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] VM Paused (Lifecycle Event)
May 26 04:59:32.263959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:32.303432 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:32.409135 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:32.475066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:32.475347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:32.475520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:32.475738 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:32.476260 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Processing event network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:32.476355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:32.476502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:32.477306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:32.477485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:32.477541 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] No waiting events found dispatching network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:32.477719 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-80523ef6-49a8-41b7-878c-1ec648f0e5b4 req-c21e77f7-e930-42b0-8745-c24a9eb59b40 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received unexpected event network-vif-plugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 for instance with vm_state building and task_state spawning.
May 26 04:59:32.478441 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:32.483919 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:32.489399 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Instance spawned successfully.
May 26 04:59:32.489921 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:32.542406 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:32.545161 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771572.5446165, e92b6ba1-ed68-40ff-b800-059778f862ac => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:32.546033 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] VM Resumed (Lifecycle Event)
May 26 04:59:32.739934 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 26 04:59:32.739934 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 04:59:32.739934 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Creating image(s)
May 26 04:59:32.740754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:32.848055 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:32.848872 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:32.849165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:32.917783 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 04:59:32.919109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.397s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:32.919660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.084s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:32.920528 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 42.70 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:59:32.923366 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:32.923518 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Claim successful on node np0000001388
May 26 04:59:32.934958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:32.935335 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Cannot resize image /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:33.006695 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.006952 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.007413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.007827 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.008783 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.009302 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:33.049660 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:33.053734 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:33.314862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db51340a-8bee-4caa-becd-5025337300f9 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.459s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:33.442578 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 04:59:33.443051 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Ensure instance console log exists: /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:33.443187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:33.443443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:33.443552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:33.446015 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start _get_guest_xml network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'a890d5fc-3b5e-4649-ab79-3f3b32743b20', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '8d835b9c-8a58-4b53-9235-c49e96173d32', 'attached_at': '2026-05-26T04:59:32.000000', 'detached_at': '', 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'serial': '575b9d98-8caa-44b9-814a-7e29ce2fc18b'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:33.448089 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:33.449542 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1700156257', uuid='8d835b9c-8a58-4b53-9235-c49e96173d32'), owner=OwnerMeta(userid='e403f092f91b47c1b1e6664b4f806bd2', username='tempest-ServerActionsTestOtherB-517547792-project-member', projectid='3e44351e7dfd4870bf0073b5f95c0423', projectname='tempest-ServerActionsTestOtherB-517547792'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771573.4490085) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:33.450570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:33.450984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:33.451759 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:33.451961 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:33.452944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:33.453324 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:33.453512 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:33.453717 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:33.453876 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:33.453999 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:33.454099 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:33.454289 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:33.455017 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:33.455183 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:33.455469 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:33.455637 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:33.467526 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:33.517492 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Took 8.31 seconds to spawn the instance on the hypervisor.
May 26 04:59:33.517664 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:33.555672 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:33.563783 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:33.563975 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:33.564236 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:33.565212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:33.565681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:59:33.566177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:33.566394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:33.566835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:33.567237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:33.584622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:33.585410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:33.585548 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:33.586913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:33.587451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:33.587717 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:33.598926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:33.598926 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:33.610252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:33.610252 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:33.616810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 04:59:33.616810 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:33.616810 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:33.616810 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:33.616810 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:33.616810 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:33.616810 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:33.617131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:33.617671 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:33.617671 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:33.626157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 04:59:33.626157 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:33.626157 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:33.626157 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:33.626157 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:33.626157 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:33.626157 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:33.626492 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:33.627449 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0389(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:33.627449 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:34.036627 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Took 15.45 seconds to build instance.
May 26 04:59:34.378946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:34.531120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:34.531667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:34.532650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:34.533531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:34.538717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.965s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:34.618937 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:34.627542 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:34.638403 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:34.638403 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.startup = manual
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.port = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 04:59:34.650324 np0000001388 nova-compute[98319]: # END RECORD
May 26 04:59:34.650324 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.661959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.661959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:34.670317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.680460 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.681214 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.691871 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.692349 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:34.697896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:34.698040 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:34.741159 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 04:59:34.741159 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 04:59:34.741159 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.750928 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 04:59:34.750928 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 04:59:34.750928 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.757589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.766223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.776878 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.777249 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:34.777668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:34.777815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:34.778996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('15', '-', '-', 0) found on session 21 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:34.779126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.786611 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:34.787044 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:34.788644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:34.788906 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 04:59:34.790983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('16', '-', '-', 0) found on session 22 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 04:59:34.790983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 04:59:34.797672 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 21 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:34.799403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:34.806255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 22 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 04:59:34.806255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 04:59:35.037766 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Detaching volume 3c16bb97-ab34-4618-a650-72a627372160
May 26 04:59:35.040870 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:59:35.108285 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Attempting to driver detach volume 3c16bb97-ab34-4618-a650-72a627372160 from mountpoint /dev/vdb
May 26 04:59:35.117001 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found disk vdb by alias ua-3c16bb97-ab34-4618-a650-72a627372160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:35.122598 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Found disk vdb by alias ua-3c16bb97-ab34-4618-a650-72a627372160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 04:59:35.122598 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Attempting to detach device vdb from instance 595593d5-7b8b-4177-a99e-d29c31010070 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 04:59:35.122816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] detach device xml: <disk type="block" device="disk">
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:35.122816 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:35.137215 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully detached device vdb from instance 595593d5-7b8b-4177-a99e-d29c31010070 from the persistent domain config.
May 26 04:59:35.137215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] (1/8): Attempting to detach device vdb with device alias ua-3c16bb97-ab34-4618-a650-72a627372160 from instance 595593d5-7b8b-4177-a99e-d29c31010070 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 04:59:35.137215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] detach device xml: <disk type="block" device="disk">
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <alias name="ua-3c16bb97-ab34-4618-a650-72a627372160"/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <serial>3c16bb97-ab34-4618-a650-72a627372160</serial>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <shareable/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]: </disk>
May 26 04:59:35.137215 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 04:59:35.140467 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0006765389998690807 future=<Future at 0x7d7aeda64b90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:35.140735 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:35.140953 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.831614013000035 future=<Future at 0x7d7aa45dc8c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:35.141186 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.8314020360000995 future=<Future at 0x7d7aa45dc8c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:35.142457 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779771560.139654, ffc28a48-a02b-4225-9a27-6c0b4f33101c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:35.142649 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] VM Stopped (Lifecycle Event)
May 26 04:59:35.201342 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:35.589398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 04:59:35.601038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:35.648491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] [instance: ffc28a48-a02b-4225-9a27-6c0b4f33101c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:35.710561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.791s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:35.710948 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:59:35.713430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.883s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:36.029368 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:36.218465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:59:36.218754 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:59:36.222055 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:36.222055 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:36.338189 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e78b48c4b4dc439086e392b4800b4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '278ea77812db4e90a14904f104739285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:59:36.538156 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] instance snapshotting
May 26 04:59:36.583523 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:36.613126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Found WWN 3300000007d246083 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 04:59:36.615567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:36.615567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-3', 'multipath_id': '3300000007d246083'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:36.615567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-3', 'multipath_id': '3300000007d246083'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 04:59:36.622259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:36.622556 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:36.714100 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Beginning live snapshot process
May 26 04:59:36.720302 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:59:37.004291 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Successfully created port: ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:59:37.136355 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:15Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:37.136355 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:37.136355 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:37.139302 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:37.145940 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <uuid>8d835b9c-8a58-4b53-9235-c49e96173d32</uuid>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <name>instance-00000003</name>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <memory>262144</memory>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-1700156257</nova:name>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:33</nova:creationTime>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:user uuid="e403f092f91b47c1b1e6664b4f806bd2">tempest-ServerActionsTestOtherB-517547792-project-member</nova:user>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:project uuid="3e44351e7dfd4870bf0073b5f95c0423">tempest-ServerActionsTestOtherB-517547792</nova:project>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         <nova:port uuid="a1df6515-d249-4964-8dc0-e810a2fa8446">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="serial">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="uuid">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <alias name="ua-575b9d98-8caa-44b9-814a-7e29ce2fc18b"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <serial>575b9d98-8caa-44b9-814a-7e29ce2fc18b</serial>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:31:f0:b0"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <target dev="tapa1df6515-d2"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/console.log" append="off"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:37.145940 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:37.150421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:15Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:37.150421 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2047413984-network", "vif_mac": "fa:16:3e:31:f0:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:37.153770 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:37.153770 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:37.153975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.154256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:37.154699 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:37.159993 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.160424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a69b89bf-87f7-54f0-b3ec-5b7d0d7e0e02', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:37.161438 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.164882 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.165544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:37.167822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.168501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1df6515-d2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:37.169048 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1df6515-d2, col_values=(('qos', UUID('c6e19101-eea0-4357-9736-3bd0ed955541')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:37.169260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1df6515-d2, col_values=(('external_ids', {'iface-id': 'a1df6515-d249-4964-8dc0-e810a2fa8446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f0:b0', 'vm-uuid': '8d835b9c-8a58-4b53-9235-c49e96173d32'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:37.174378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:37.178420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:37.180098 np0000001388 nova-compute[98319]: INFO os_vif [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 04:59:37.201216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771577.2008579, 595593d5-7b8b-4177-a99e-d29c31010070 => ua-3c16bb97-ab34-4618-a650-72a627372160> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 04:59:37.205770 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3c16bb97-ab34-4618-a650-72a627372160 for instance 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 04:59:37.209184 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully detached device vdb from instance 595593d5-7b8b-4177-a99e-d29c31010070 from the live domain config.
May 26 04:59:37.228066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:59:37.269333 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 04:59:37.270535 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:37.271216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:37.271885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:37.272705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3c16bb97-ab34-4618-a650-72a627372160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 04:59:37.272897 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:37.313219 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [19] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [20] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:37.313728 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '19'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '20'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 04:59:37.313728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '19')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:37.315299 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160', '20')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:37.316488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa45923e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'): ({'sdo'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'): ({'sdn'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 04:59:37.316694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Removing multipathed devices sdn, sdo {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 04:59:37.316924 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Flush multipath device 3300000001c9041c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 04:59:37.359461 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:37.423895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:37.466066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 04:59:37.466356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 04:59:37.468108 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 04:59:37.483593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 04:59:37.483881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 04:59:37.499109 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.544129 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.40.100,3260]
May 26 04:59:37.544129 np0000001388 nova-compute[98319]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.40.100,3260] successful.
May 26 04:59:37.544129 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.564439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.578052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.621591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.50.100,3260]
May 26 04:59:37.621591 np0000001388 nova-compute[98319]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-3c16bb97-ab34-4618-a650-72a627372160, portal: 192.168.50.100,3260] successful.
May 26 04:59:37.621591 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.653674 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:37.653825 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:37.654032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] <== disconnect_volume: return (383ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:37.654312 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 04:59:37.660090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.947s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:37.662900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.060s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:37.667312 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:37.667312 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Claim successful on node np0000001388
May 26 04:59:37.695288 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Successfully updated port: ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:59:37.732724 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Deleted allocations for instance 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0
May 26 04:59:37.774774 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-changed-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:37.774972 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Refreshing instance network info cache due to event network-changed-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:37.775219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] Acquiring lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:37.777222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] Acquired lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:37.777222 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Refreshing network info cache for port ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:38.198533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:38.214401 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'flavor' on Instance uuid 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:38.233802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.246169 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:38.257215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:38.258425 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating image(s)
May 26 04:59:38.259307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:38.259307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:38.259840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:38.260527 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.263945 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.268218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.282162 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:38.326163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.327107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.355910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.359219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:38.359219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:38.359219 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.361749 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.362819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.414928 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:38.431913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json -f qcow2" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.433110 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.436067 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:38.436541 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.471778 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.472505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.533835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk 1073741824" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.534744 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:38.535246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.552146 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.554742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.610929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c.delta 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.611511 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Quiescing instance not available: QEMU guest agent is not enabled.
May 26 04:59:38.654707 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.655222 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:38.655349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:38.688385 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:38.739778 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:38.739971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:38.740133 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:38.743552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] No VIF found with MAC fa:16:3e:31:f0:b0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:38.744499 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Using config drive
May 26 04:59:38.761522 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e668a12-bc24-4e9a-9804-9b74b3b5a0d3 tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "84b0e38d-d94f-442c-b26c-5adfb9ad5bc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.861s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:38.762733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:38.763164 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Cannot resize image /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:38.765292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:59:38.765292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Ensure instance console log exists: /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:38.765951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:38.766115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:38.766325 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:38.940877 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 04:59:38.943713 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Skipping quiescing instance: QEMU guest agent is not enabled.
May 26 04:59:39.086640 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 04:59:39.087026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c.delta /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:39.195258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-405fff1c-5a91-49d6-b267-1171f58ff2c1 req-f3c706ac-6bf4-47c3-9225-6b48e5455108 service nova] Releasing lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:39.195918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:39.196169 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:39.231861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c.delta /opt/stack/data/nova/instances/snapshots/tmpdtoe3y_3/8008871f365e4fb68682dadf484ff98c" returned: 0 in 0.145s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:39.232664 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Snapshot extracted, beginning image upload
May 26 04:59:39.236344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bf427f11-33b3-48e9-b237-1dd75045aff2 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.705s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:39.520697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:39.540480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:39.541762 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:39.551142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:39.553402 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:39.694761 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:39.852375 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:39.973252 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005101940000713512 future=<Future at 0x7d7aa45dc8c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:39.973252 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:39.973436 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.86307469999997 future=<Future at 0x7d7aed9f76b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:39.973915 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.8629611169999407 future=<Future at 0x7d7aed9f76b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:39.974121 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Emitting event <LifecycleEvent: 1779771564.9725068, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:39.974374 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Stopped (Lifecycle Event)
May 26 04:59:39.979138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:39.979362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:39.979656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:39.979866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:39.980726 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:39.985815 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Terminating instance
May 26 04:59:40.031046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.043994 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:40.057490 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.060279 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:40.060279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:40.060400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:40.060499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:40.060611 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:40.062951 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-2ba227f3-2c70-406b-afc6-66dc8d9d6213 req-1173efa0-3364-4654-b9df-cca1af5ad11c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state active and task_state resize_finish.
May 26 04:59:40.119984 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:40.120221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:40.121099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:40.121099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:40.121099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:40.135958 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Terminating instance
May 26 04:59:40.281885 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:40.478433 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-36b945d4-0f25-4ce4-bcb7-cce186e6c842 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:40.494262 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:59:40.523523 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating instance_info_cache with network_info: [{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:40.529760 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.557467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.560082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.899s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:40.560986 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:59:40.645257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:59:40.685944 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.694602 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.718560 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.776093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] No waiting events found dispatching network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:40.777691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f287d2b7-1223-4434-b8c6-3e9a678d40ae req-e6204708-7799-40f8-88b1-387294884f15 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:40.783043 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.818961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.842464 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:40.843480 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771580.8430474, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:40.843649 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Resumed (Lifecycle Event)
May 26 04:59:40.858016 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.859864 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance running successfully.
May 26 04:59:40.861253 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:40.862993 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 26 04:59:40.863325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cb07cb39-b5ce-4c97-81e8-4f62ec3831b2 tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 26 04:59:41.039881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:41.039881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance network_info: |[{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:41.040144 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start _get_guest_xml network_info=[{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:41.060030 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:41.061485 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-tempest.common.compute-instance-215111684', uuid='d8186beb-e5d9-41ee-8a66-17f7921ed75c'), owner=OwnerMeta(userid='e78b48c4b4dc439086e392b4800b4ad7', username='tempest-ServerActionsTestOtherA-846952046-project-member', projectid='278ea77812db4e90a14904f104739285', projectname='tempest-ServerActionsTestOtherA-846952046'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771581.061069) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:41.062474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.068326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:41.068697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:41.078905 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:59:41.080989 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:59:41.081334 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:41.084167 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:41.086775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:41.092843 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:41.094151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:41.101371 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:41.101589 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:41.101727 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:41.101898 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:41.102001 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:41.102231 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:41.104059 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:41.104135 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:41.104520 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:41.106268 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Instance destroyed successfully.
May 26 04:59:41.106601 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:41.106821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.111921 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:41.119156 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'resources' on Instance uuid 7e0085ac-d343-4e32-85db-8489cbf3a677 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:41.121077 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.140113 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.150431 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Instance destroyed successfully.
May 26 04:59:41.150829 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lazy-loading 'resources' on Instance uuid 595593d5-7b8b-4177-a99e-d29c31010070 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:41.156005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-tempest.common.compute-instance-215111684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:41.160932 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:41.161970 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:41.163537 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'pci_devices' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:41.253676 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86198cd150d6446aa52f0f2706b3c9ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5d660575e954baf8f26c989e3b488de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:59:41.354889 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:41.357511 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:41.578259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.593170 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.594871 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.599215 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:59:41.608159 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.645255 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-1',id=5,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=7e0085ac-d343-4e32-85db-8489cbf3a677,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:41.645440 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "4b55beac-defe-45b7-8158-98dd534cbe0d", "address": "fa:16:3e:5f:78:a1", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b55beac-de", "ovs_interfaceid": "4b55beac-defe-45b7-8158-98dd534cbe0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:41.647110 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:41.647110 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:41.648292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.652006 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.652542 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b55beac-de, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.655287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.656790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.660934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.666103 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-1461376653-2',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testmultiattachvolumeswap-server-1461376653-2',id=6,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLEtC3+iICKzWAjAPECmSeGrmJW4tpiz6HoH/si/lTmxzLF0vzVny8uSedCB+a6RA7JsI0G2SemAe0Jyl0QULEduLzh5s8DMpptNxrhqPyk2fzs9r5mTSvFHSkP7/5SEw==',key_name='tempest-keypair-733205610',keypairs=<?>,launch_index=1,launched_at=2026-05-26T04:58:28Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6324f4c1c47a4936ba1ff72bba1fe12b',ramdisk_id='',reservation_id='r-1sk707dg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1732757564',owner_user_name='tempest-TestMultiAttachVolumeSwap-1732757564-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3630ce8e1080445181b66720eb588b87',uuid=595593d5-7b8b-4177-a99e-d29c31010070,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:41.666551 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converting VIF {"id": "25738872-72e4-45c4-a2e9-343e565dcf1b", "address": "fa:16:3e:27:0c:d3", "network": {"id": "aed7e157-9c49-42f7-a0cb-d041d34180bc", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1685632974-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6324f4c1c47a4936ba1ff72bba1fe12b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap25738872-72", "ovs_interfaceid": "25738872-72e4-45c4-a2e9-343e565dcf1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:41.667031 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:41.667792 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <uuid>d8186beb-e5d9-41ee-8a66-17f7921ed75c</uuid>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <name>instance-0000000d</name>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:name>tempest-tempest.common.compute-instance-215111684</nova:name>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:41</nova:creationTime>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:user uuid="e78b48c4b4dc439086e392b4800b4ad7">tempest-ServerActionsTestOtherA-846952046-project-member</nova:user>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:project uuid="278ea77812db4e90a14904f104739285">tempest-ServerActionsTestOtherA-846952046</nova:project>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         <nova:port uuid="ed4c3636-8554-40bd-a26d-2cb5dbd0fd79">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="serial">d8186beb-e5d9-41ee-8a66-17f7921ed75c</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="uuid">d8186beb-e5d9-41ee-8a66-17f7921ed75c</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b9:51:f5"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <target dev="taped4c3636-85"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/console.log" append="off"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:41.672482 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Preparing to wait for external event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:41.672482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:41.675701 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-tempest.common.compute-instance-215111684',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:41.675701 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:41.675701 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:41.675701 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:41.677330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.677330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.677330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25738872-72, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.683302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.683302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.683853 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.685658 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.686010 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.686389 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:41.686664 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.690978 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ec54ef7-bd4d-4564-ae2a-2a7638d8b257) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.697379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.697379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.697379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.697379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34660f0e-8bf4-4d83-ade2-827a8637b4c7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.700868 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.703845 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.704094 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.705446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f46a159-5026-5d92-80b6-47071bd63998', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.710364 np0000001388 nova-compute[98319]: INFO os_vif [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:78:a1,bridge_name='br-int',has_traffic_filtering=True,id=4b55beac-defe-45b7-8158-98dd534cbe0d,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b55beac-de')
May 26 04:59:41.713089 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Deleting instance files /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677_del
May 26 04:59:41.713295 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.715947 np0000001388 nova-compute[98319]: INFO os_vif [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:0c:d3,bridge_name='br-int',has_traffic_filtering=True,id=25738872-72e4-45c4-a2e9-343e565dcf1b,network=Network(aed7e157-9c49-42f7-a0cb-d041d34180bc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25738872-72')
May 26 04:59:41.717110 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Deleting instance files /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070_del
May 26 04:59:41.718036 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Deletion of /opt/stack/data/nova/instances/7e0085ac-d343-4e32-85db-8489cbf3a677_del complete
May 26 04:59:41.724784 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.725192 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped4c3636-85, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.728088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped4c3636-85, col_values=(('qos', UUID('0d41f36d-ab7b-4c36-948b-3cc2c7b179ce')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.728088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped4c3636-85, col_values=(('external_ids', {'iface-id': 'ed4c3636-8554-40bd-a26d-2cb5dbd0fd79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:51:f5', 'vm-uuid': 'd8186beb-e5d9-41ee-8a66-17f7921ed75c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:41.730016 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Deletion of /opt/stack/data/nova/instances/595593d5-7b8b-4177-a99e-d29c31010070_del complete
May 26 04:59:41.740117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:41.740974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.743561 np0000001388 nova-compute[98319]: INFO os_vif [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85')
May 26 04:59:41.814412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.848541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.852866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:41.861755 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 26 04:59:41.863590 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771581.8630571, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:41.863590 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Started (Lifecycle Event)
May 26 04:59:41.873821 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 04:59:42.108295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:59:42.211581 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.213348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.213697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.214460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.214648 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.215188 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state None.
May 26 04:59:42.215393 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.215641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.215830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.215962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.216102 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.216246 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.217079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:42.218022 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.218022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.218022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.218220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.218268 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.218439 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received unexpected event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with vm_state active and task_state deleting.
May 26 04:59:42.218519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.219019 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.220660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.220850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.221015 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.221182 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received unexpected event network-vif-plugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with vm_state active and task_state deleting.
May 26 04:59:42.221360 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:42.221528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:42.222285 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:42.222503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:42.222657 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:42.222842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a9ca54f4-0a55-4ed1-a345-7909b17561a8 req-38ddfd37-0809-43cd-a2c9-4d211c6dcb56 service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:42.233772 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Took 1.74 seconds to destroy the instance on the hypervisor.
May 26 04:59:42.234481 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:59:42.236163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:59:42.236163 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:59:42.236163 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:42.246126 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Took 1.60 seconds to destroy the instance on the hypervisor.
May 26 04:59:42.247452 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:59:42.247663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:59:42.247781 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:59:42.248002 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:42.344229 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:42.368151 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:42.370596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:42.390625 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:42.725025 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Successfully created port: 1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:59:42.875253 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999710075999928 future=<Future at 0x7d7aa445bdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:42.875477 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999817137000036 future=<Future at 0x7d7aa45dfbc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:43.018815 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:43.019135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] Acquiring lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:43.019331 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:43.019497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:43.019652 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] No waiting events found dispatching network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:43.021349 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-134c3861-b377-4f8d-ae9d-fd73095f3e29 req-13b758cd-83d5-4c9d-ae48-23367aa50070 service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-unplugged-4b55beac-defe-45b7-8158-98dd534cbe0d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:43.125079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:43.125698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:43.126130 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Creating image(s)
May 26 04:59:43.128247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:43.128247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:43.130690 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:43.132992 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:43.137586 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:43.140507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:43.169416 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ff34b2d-972c-407b-8de1-cdd983d12954 req-72e429f1-24bf-4b98-a58e-d7b8d422a70e service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-deleted-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:43.169580 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-4ff34b2d-972c-407b-8de1-cdd983d12954 req-72e429f1-24bf-4b98-a58e-d7b8d422a70e service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Neutron deleted interface 25738872-72e4-45c4-a2e9-343e565dcf1b; detaching it from the instance and deleting it from the info cache
May 26 04:59:43.169919 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4ff34b2d-972c-407b-8de1-cdd983d12954 req-72e429f1-24bf-4b98-a58e-d7b8d422a70e service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:43.254640 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:43.273811 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:43.274016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:43.274092 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:b9:51:f5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:43.274699 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Using config drive
May 26 04:59:43.282423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.142s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:43.285497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:43.285497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:43.285497 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:43.288799 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 04:59:43.289336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:43.403674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:43.404656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:43.449949 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:43.468852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk 1073741824" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:43.469810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:43.470262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:43.579165 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:43.593227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:43.593803 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 04:59:43.594571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:43.644345 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Snapshot image upload complete
May 26 04:59:43.644345 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5963a01a-05da-439e-b365-8227289fcd84 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Took 7.10 seconds to snapshot the instance on the hypervisor.
May 26 04:59:43.682361 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ff34b2d-972c-407b-8de1-cdd983d12954 req-72e429f1-24bf-4b98-a58e-d7b8d422a70e service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Detach interface failed, port_id=25738872-72e4-45c4-a2e9-343e565dcf1b, reason: Instance 595593d5-7b8b-4177-a99e-d29c31010070 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 04:59:43.716812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Cannot resize image /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Ensure instance console log exists: /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:43.720222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:43.791273 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:43.837084 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005083280000235391 future=<Future at 0x7d7aed9f76b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:43.837238 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:43.837411 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.037459061999925 future=<Future at 0x7d7aa445bdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:43.837540 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.037317786999893 future=<Future at 0x7d7aa445bdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:43.840129 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Emitting event <LifecycleEvent: 1779771568.83641, 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:43.840129 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] VM Stopped (Lifecycle Event)
May 26 04:59:43.957218 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Took 1.72 seconds to deallocate network for instance.
May 26 04:59:43.969289 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating config drive at /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config
May 26 04:59:43.981024 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxenx0la {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:44.042594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgxenx0la" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:44.081374 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:44.083384 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Took 1.84 seconds to deallocate network for instance.
May 26 04:59:44.231070 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:44.231539 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:44.232316 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:44.268744 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Successfully updated port: 1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:59:44.334667 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Port a1df6515-d249-4964-8dc0-e810a2fa8446 binding to destination host np0000001388 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 26 04:59:44.334858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:44.335023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:44.335189 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:44.341826 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:44.344326 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] Acquiring lock "595593d5-7b8b-4177-a99e-d29c31010070-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:44.351077 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 84b0e38d-d94f-442c-b26c-5adfb9ad5bc0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:44.351077 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:44.351077 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] Lock "595593d5-7b8b-4177-a99e-d29c31010070-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:44.351077 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] No waiting events found dispatching network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:44.351309 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Received unexpected event network-vif-unplugged-25738872-72e4-45c4-a2e9-343e565dcf1b for instance with vm_state deleted and task_state None.
May 26 04:59:44.354257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d9512ae9-51ea-4bfa-bec3-ce253f7de6e2 req-8ea6da90-96e8-443e-915f-dd984a08d4aa service nova] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Received event network-vif-deleted-4b55beac-defe-45b7-8158-98dd534cbe0d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:44.469430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:44.469676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:44.591941 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:44.600505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:44.627554 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:44.639138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:44.746293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:44.775394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:44.775394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquired lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:44.775394 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:44.837889 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:44.842735 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:45.346260 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0570d74e-d9c0-4798-9749-d12eea814b70 req-ea2ed934-fe39-4a0d-94f7-8fb242bd13eb service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:45.347638 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0570d74e-d9c0-4798-9749-d12eea814b70 req-ea2ed934-fe39-4a0d-94f7-8fb242bd13eb service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:45.348574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0570d74e-d9c0-4798-9749-d12eea814b70 req-ea2ed934-fe39-4a0d-94f7-8fb242bd13eb service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:45.348710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0570d74e-d9c0-4798-9749-d12eea814b70 req-ea2ed934-fe39-4a0d-94f7-8fb242bd13eb service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:45.348845 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0570d74e-d9c0-4798-9749-d12eea814b70 req-ea2ed934-fe39-4a0d-94f7-8fb242bd13eb service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Processing event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:45.418262 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:45.546808 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:45.551540 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:45.554409 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:45.678279 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:45.739725 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:45.772555 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771585.771623, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:45.774103 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Started (Lifecycle Event)
May 26 04:59:45.776525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:45.781047 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:45.782758 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance spawned successfully.
May 26 04:59:45.783087 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:45.881709 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updating instance_info_cache with network_info: [{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:45.988414 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:46.061153 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:46.243863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:46.280117 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:46.284810 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:46.295529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.295529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.295529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.295529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.296988 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.298142 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:46.388604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Releasing lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:46.391168 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Instance network_info: |[{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:46.395666 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Start _get_guest_xml network_info=[{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:46.409304 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:46.411346 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759', uuid='ecc66071-7d58-4b53-ad30-1b259d40f744'), owner=OwnerMeta(userid='86198cd150d6446aa52f0f2706b3c9ae', username='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member', projectid='f5d660575e954baf8f26c989e3b488de', projectname='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771586.410408) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:46.415013 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:46.415013 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:46.419160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:46.420348 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:46.421269 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:46.421820 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:46.422152 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:46.422380 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:46.422574 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:46.422672 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:46.422816 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:46.423055 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:46.423245 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:46.423434 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:46.423599 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:46.423709 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:46.457936 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-changed-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:46.460469 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Refreshing instance network info cache due to event network-changed-1864280c-210d-4b7c-98d4-011d3c95285a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:46.462971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] Acquiring lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:46.463290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] Acquired lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:46.464897 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Refreshing network info cache for port 1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:46.472327 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachscenariooldversion-server-1504326',id=14,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOarlfsbo8DF77ek4aBHiVl88HpslLarEpf3Bg1CoA2ylk84pfwG/8vglrq+32Gca4M279IQoimi5zWKGKeDW7D5dqwaaKR82OGzGW7gM6IDjbRJcEbk3goahuMrzeQX3Q==',key_name='tempest-keypair-1080471052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d660575e954baf8f26c989e3b488de',ramdisk_id='',reservation_id='r-2o5ktrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86198cd150d6446aa52f0f2706b3c9ae',uuid=ecc66071-7d58-4b53-ad30-1b259d40f744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 04:59:46.473232 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converting VIF {"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:46.478078 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:46.480285 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lazy-loading 'pci_devices' on Instance uuid ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:46.578657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:46.584729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:46.587039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.986s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:46.588284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:46.588284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:46.588284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:46.588447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:46.592106 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Terminating instance
May 26 04:59:46.645223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:46.657010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:46.657901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:46.692288 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Deleted allocations for instance 7e0085ac-d343-4e32-85db-8489cbf3a677
May 26 04:59:46.730820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:46.748779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Creating tmpfile /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/tmp5yyjyvvy to verify with other compute node that the instance is on the same shared storage. {{(pid=98319) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10552}}
May 26 04:59:46.749108 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 04:59:46.794061 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:46.794431 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771586.7940953, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:46.794632 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Paused (Lifecycle Event)
May 26 04:59:46.804397 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Took 8.55 seconds to spawn the instance on the hypervisor.
May 26 04:59:46.804397 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:46.980067 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:46.985444 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] End _get_guest_xml xml=<domain type="qemu">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <uuid>ecc66071-7d58-4b53-ad30-1b259d40f744</uuid>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <name>instance-0000000e</name>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <metadata>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759</nova:name>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:46</nova:creationTime>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       </nova:image>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:user uuid="86198cd150d6446aa52f0f2706b3c9ae">tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member</nova:user>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:project uuid="f5d660575e954baf8f26c989e3b488de">tempest-TestServerVolumeAttachScenarioOldVersion-1645301185</nova:project>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         <nova:port uuid="1864280c-210d-4b7c-98d4-011d3c95285a">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:         </nova:port>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </metadata>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <system>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="serial">ecc66071-7d58-4b53-ad30-1b259d40f744</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="uuid">ecc66071-7d58-4b53-ad30-1b259d40f744</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </system>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <os>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </os>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <features>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <acpi/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <tcg>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </tcg>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </features>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </cpu>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   <devices>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.config"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </disk>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:37:09:90"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <target dev="tap1864280c-21"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </interface>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/console.log" append="off"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </serial>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <video>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </video>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </rng>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:     </memballoon>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:   </devices>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]: </domain>
May 26 04:59:46.985444 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Preparing to wait for external event network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachscenariooldversion-server-1504326',id=14,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOarlfsbo8DF77ek4aBHiVl88HpslLarEpf3Bg1CoA2ylk84pfwG/8vglrq+32Gca4M279IQoimi5zWKGKeDW7D5dqwaaKR82OGzGW7gM6IDjbRJcEbk3goahuMrzeQX3Q==',key_name='tempest-keypair-1080471052',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5d660575e954baf8f26c989e3b488de',ramdisk_id='',reservation_id='r-2o5ktrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86198cd150d6446aa52f0f2706b3c9ae',uuid=ecc66071-7d58-4b53-ad30-1b259d40f744,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converting VIF {"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:46.991965 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 04:59:46.993113 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:46.993474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:46.993763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 04:59:46.995027 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:46.997537 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6ec8a195-e593-501f-8a28-49e95f9773f7', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:46.999823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.001766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.002169 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:47.003425 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.006965 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.007693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1864280c-21, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:47.007770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1864280c-21, col_values=(('qos', UUID('22590a57-7bb2-4941-bc14-4a328ffb8a24')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:47.008096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1864280c-21, col_values=(('external_ids', {'iface-id': '1864280c-210d-4b7c-98d4-011d3c95285a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:09:90', 'vm-uuid': 'ecc66071-7d58-4b53-ad30-1b259d40f744'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:47.011511 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.012440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:47.019766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.022444 np0000001388 nova-compute[98319]: INFO os_vif [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21')
May 26 04:59:47.107747 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 04:59:47.139837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.146292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.163587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 04:59:47.171619 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.177562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.219587 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.220296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.300110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.302017 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:47.308303 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.309447 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771587.308888, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:47.309447 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Resumed (Lifecycle Event)
May 26 04:59:47.318449 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Took 17.55 seconds to build instance.
May 26 04:59:47.336854 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.342313 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.388832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.456728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:47.460568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:47.460732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:47.460888 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:47.461082 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:47.461254 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3a4b9ca9-3256-44f8-aab1-2b52440e7265 req-a3c0f776-d3e3-42f3-a898-48aa5a74ba93 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received unexpected event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with vm_state active and task_state None.
May 26 04:59:47.474214 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:47.583182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:47.583520 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:47.626357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.665530 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Instance destroyed successfully.
May 26 04:59:47.666503 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lazy-loading 'resources' on Instance uuid 6b3962c4-d73d-4c08-a0bf-751265f8b607 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:47.667238 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.707512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:47.710726 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8a28c9bf-981e-4fab-91fe-dc819f9ea7d6 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "7e0085ac-d343-4e32-85db-8489cbf3a677" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.731s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:47.716412 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance destroyed successfully.
May 26 04:59:47.716412 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'resources' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:47.790529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:47.818275 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updated VIF entry in instance network info cache for port 1864280c-210d-4b7c-98d4-011d3c95285a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:47.819079 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updating instance_info_cache with network_info: [{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:47.824897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:47.825885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a400d9cd-e33e-4cb1-b6a9-f2572a3fd4cc tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.073s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:47.826915 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:48.056800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.077452 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.087478 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:48.100100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.118179 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.180549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-74587674',display_name='tempest-ServersNegativeTestJSON-server-74587674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serversnegativetestjson-server-74587674',id=10,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:09Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fec238eac0a44f19ba4295e8c72b582',ramdisk_id='',reservation_id='r-cu7ycdb8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1974443015',owner_user_name='tempest-ServersNegativeTestJSON-1974443015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:09Z,user_data=None,user_id='1e56d19720934fccb862b18021b97675',uuid=6b3962c4-d73d-4c08-a0bf-751265f8b607,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:48.180549 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converting VIF {"id": "4cca346b-bc09-4cf8-957b-138449d50f56", "address": "fa:16:3e:fa:c9:fe", "network": {"id": "4929d445-0c6b-4822-b937-619a63dfc670", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2101625290-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6fec238eac0a44f19ba4295e8c72b582", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cca346b-bc", "ovs_interfaceid": "4cca346b-bc09-4cf8-957b-138449d50f56", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:48.181045 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:48.181291 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:48.182922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.183172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cca346b-bc, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:48.184988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.185464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:48.197381 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.199145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.199553 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05f690ba-316f-4ed7-b8f3-2ba13f8e1cdb) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:48.202950 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.203697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:48.220442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.223737 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:41Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 04:59:48.225088 np0000001388 nova-compute[98319]: INFO os_vif [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:c9:fe,bridge_name='br-int',has_traffic_filtering=True,id=4cca346b-bc09-4cf8-957b-138449d50f56,network=Network(4929d445-0c6b-4822-b937-619a63dfc670),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cca346b-bc')
May 26 04:59:48.225088 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 04:59:48.225290 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 04:59:48.225534 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 04:59:48.226648 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Deleting instance files /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607_del
May 26 04:59:48.227246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.227571 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1df6515-d2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:48.229653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.230258 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:48.232121 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Deletion of /opt/stack/data/nova/instances/6b3962c4-d73d-4c08-a0bf-751265f8b607_del complete
May 26 04:59:48.239146 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.241809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.242729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6e19101-eea0-4357-9736-3bd0ed955541) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 04:59:48.243884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.244432 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 04:59:48.250446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: INFO os_vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 04:59:48.260730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 04:59:48.263442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.289955 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:48.299435 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [21] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [22] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 04:59:48.300120 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 04:59:48.300120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '21')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:48.300918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '22')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 04:59:48.303893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46e8ea0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 04:59:48.304296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Removing multipathed devices sdk, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 04:59:48.304619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flush multipath device 3300000007d246083 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 04:59:48.323655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-425072e3-8634-493d-a80b-923ed7aa0946 req-d17320a8-e8e2-4ca7-96e5-01934ed86c43 service nova] Releasing lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:48.332068 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999645795999868 future=<Future at 0x7d7aa446e780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:48.332068 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999646686999995 future=<Future at 0x7d7ac43cadb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:48.347718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:48.402148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 04:59:48.455549 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 04:59:48.455715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 04:59:48.456894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 04:59:48.470854 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 04:59:48.471124 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 04:59:48.486168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.517984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 04:59:48.517984 np0000001388 nova-compute[98319]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 04:59:48.517984 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.542802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.558316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:48.558316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 04:59:48.558316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No VIF found with MAC fa:16:3e:37:09:90, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 04:59:48.558316 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Using config drive
May 26 04:59:48.562810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.578770 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.584771 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:48.585091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.585305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.585573 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] No waiting events found dispatching network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:48.585841 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:48.586081 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.586330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Acquiring lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:48.586574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.586772 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.586946 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] No waiting events found dispatching network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:48.587312 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-unplugged-4cca346b-bc09-4cf8-957b-138449d50f56 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 04:59:48.587312 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.587409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:48.587590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.587898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.589186 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:48.589335 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:48.589439 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.589560 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:48.589676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.589803 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.589951 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:48.590075 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:48.590192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.590346 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:48.590496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.590634 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.590745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:48.590891 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d85b9202-84a9-4d5d-abf7-d41ad5efc1d3 req-62c2bad6-d74e-4bdf-9955-c5319c2bef3c service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:48.596215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.011s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:48.598711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.809s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:48.602911 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 04:59:48.603215 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Claim successful on node np0000001388
May 26 04:59:48.607497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 04:59:48.607497 np0000001388 nova-compute[98319]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 04:59:48.607497 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.627344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:48.627680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 04:59:48.627842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== disconnect_volume: return (371ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:48.628041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 04:59:48.711051 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Deleted allocations for instance 595593d5-7b8b-4177-a99e-d29c31010070
May 26 04:59:48.720449 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-changed-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:48.722640 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Refreshing instance network info cache due to event network-changed-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:48.724459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] Acquiring lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:48.724609 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] Acquired lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:48.724848 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Refreshing network info cache for port ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:48.744844 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Took 1.64 seconds to destroy the instance on the hypervisor.
May 26 04:59:48.749976 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 04:59:48.750899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 04:59:48.751042 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 04:59:48.751295 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:48.906371 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:49.069425 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:49.229297 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:49.253916 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Creating config drive at /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.config
May 26 04:59:49.264279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv4md27d {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:49.316570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzv4md27d" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 04:59:49.714976 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:49.722780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-abfd916b-b8de-41d6-8174-07f63c1dbe52 tempest-TestMultiAttachVolumeSwap-1732757564 tempest-TestMultiAttachVolumeSwap-1732757564-project-member] Lock "595593d5-7b8b-4177-a99e-d29c31010070" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.603s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:49.745860 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:49.859492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:49.880386 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:49.912245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:49.951661 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updated VIF entry in instance network info cache for port ed4c3636-8554-40bd-a26d-2cb5dbd0fd79. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:49.952004 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating instance_info_cache with network_info: [{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:50.017711 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:50.253668 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Took 1.50 seconds to deallocate network for instance.
May 26 04:59:50.340419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:50.354295 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:50.396675 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:50.406188 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:50.407555 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:50.455921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d064009f-c78e-4303-9a2d-f01e8093b3ad req-739aeaa1-94eb-4ae6-9c65-d665b0d21242 service nova] Releasing lock "refresh_cache-d8186beb-e5d9-41ee-8a66-17f7921ed75c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:50.701134 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:50.701428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:50.702254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:50.702500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:50.703303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:50.703303 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:50.704248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:50.704248 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:50.704248 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:50.704248 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:50.704248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:50.705509 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:50.705509 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:50.705509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:50.705509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:50.706108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:50.706553 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:50.706776 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-291ef05a-1b4e-452d-9b72-435b11876227 req-a2309a93-4113-472c-8e56-5aa946274282 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 04:59:50.769068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:50.820311 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f071e4d0-efe6-4e74-868f-a3f269e06b68 req-16f3089e-f7e3-490c-80e2-e154d046c762 service nova] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Received event network-vif-deleted-4cca346b-bc09-4cf8-957b-138449d50f56 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:50.910188 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:51.068978 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771591.0684662, ecc66071-7d58-4b53-ad30-1b259d40f744 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:51.069210 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] VM Started (Lifecycle Event)
May 26 04:59:51.419534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.821s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:51.420233 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 04:59:51.423426 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 1.564s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:51.575400 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:51.579354 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771591.577898, ecc66071-7d58-4b53-ad30-1b259d40f744 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:51.579354 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] VM Paused (Lifecycle Event)
May 26 04:59:51.639657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:51.649653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:51.927836 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 04:59:51.928725 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'migration_context' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:51.932227 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 04:59:51.932227 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:51.932227 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:52.049808 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d25c63261bb45f1bc8ab1e39768c377', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89f7e0bdf71e47a9b6de4e03f880f492', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 04:59:52.083578 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:52.086239 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:52.429679 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 04:59:52.434726 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Object Instance<8d835b9c-8a58-4b53-9235-c49e96173d32> lazy-loaded attributes: resources,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 04:59:52.593757 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:52.925411 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Successfully created port: af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 04:59:52.938868 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 04:59:53.074922 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-20bcdccf-baff-420c-b924-65df01c374c6 req-0644e416-ad03-4175-a32a-123a107ba352 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:53.078252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20bcdccf-baff-420c-b924-65df01c374c6 req-0644e416-ad03-4175-a32a-123a107ba352 service nova] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:53.078541 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20bcdccf-baff-420c-b924-65df01c374c6 req-0644e416-ad03-4175-a32a-123a107ba352 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:53.078718 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20bcdccf-baff-420c-b924-65df01c374c6 req-0644e416-ad03-4175-a32a-123a107ba352 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:53.078833 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-20bcdccf-baff-420c-b924-65df01c374c6 req-0644e416-ad03-4175-a32a-123a107ba352 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Processing event network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 04:59:53.079814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 04:59:53.084647 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 04:59:53.085556 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771593.0850992, ecc66071-7d58-4b53-ad30-1b259d40f744 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:53.085791 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] VM Resumed (Lifecycle Event)
May 26 04:59:53.089824 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Instance spawned successfully.
May 26 04:59:53.091207 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 04:59:53.244761 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:53.265579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:53.265579 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:53.448003 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Booting with volume-backed-image eb1b37ef-ecaa-41a5-b927-a074eae64cb1 at /dev/vda
May 26 04:59:53.588996 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:53.591128 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 04:59:53.600398 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.600570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.600992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.601342 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.601663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.602016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 04:59:53.769988 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:54.101827 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 04:59:54.109692 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Took 10.98 seconds to spawn the instance on the hypervisor.
May 26 04:59:54.111041 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:54.338764 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Successfully updated port: af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 04:59:54.627498 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Took 19.08 seconds to build instance.
May 26 04:59:54.794245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.371s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:54.794357 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 04:59:54.799513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 4.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:54.843577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:54.844000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:54.844188 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:54.967390 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:55.129730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.597s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:55.195140 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:55.195140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:55.195140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:55.195140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:55.195140 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] No waiting events found dispatching network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:55.195316 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received unexpected event network-vif-plugged-1864280c-210d-4b7c-98d4-011d3c95285a for instance with vm_state active and task_state None.
May 26 04:59:55.195316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-changed-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:55.195596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Refreshing instance network info cache due to event network-changed-af02a518-4683-4fb9-88cb-e597d6024a76. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:55.195596 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Acquiring lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:55.445937 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 04:59:55.448404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:55.588597 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 04:59:55.589022 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 04:59:55.710641 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:56.035265 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:56.094225 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 04:59:56.396592 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Swapping old allocation on dict_keys(['532664ff-66ca-4f17-bdd2-18f1300079ea']) held by migration f403b878-081a-4148-97f0-fd3b4405a983 for instance
May 26 04:59:56.514564 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Overwriting current allocation {'allocations': {'532664ff-66ca-4f17-bdd2-18f1300079ea': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 19}}, 'project_id': '3e44351e7dfd4870bf0073b5f95c0423', 'user_id': 'e403f092f91b47c1b1e6664b4f806bd2', 'consumer_generation': 1} on consumer 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}}
May 26 04:59:56.538111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:56.538629 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance network_info: |[{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 04:59:56.539475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Acquired lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:56.539475 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Refreshing network info cache for port af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:56.600860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.801s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:56.620395 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:56.654544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:56.691478 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Deleted allocations for instance 6b3962c4-d73d-4c08-a0bf-751265f8b607
May 26 04:59:56.752391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:56.752887 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquired lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:56.752887 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 04:59:57.043957 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:57.138227 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-changed-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:57.138227 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Refreshing instance network info cache due to event network-changed-1864280c-210d-4b7c-98d4-011d3c95285a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 04:59:57.138227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] Acquiring lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 04:59:57.138227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] Acquired lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 04:59:57.138227 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Refreshing network info cache for port 1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 04:59:57.257662 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:57.516316 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:57.536253 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:57.556253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:59:57.584301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:57.636311 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:57.636853 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:59:57.644063 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:57.653296 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 04:59:57.654211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:57.654537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:57.656949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:57.667295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 04:59:57.667437 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e056b61d-5bf3-4f46-a1da-0b58d6127bbc req-27bdcab9-62ee-4be9-b521-249c6d2bf1f9 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state building and task_state block_device_mapping.
May 26 04:59:57.668311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:59:57.670472 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe55:64fe', 'fe80::d4b4:38ff:fe98:dac2', 'fe80::fc16:3eff:fe4c:5822', 'fe80::fc16:3eff:fed7:218f', 'fe80::fc16:3eff:fe03:14a3', 'fe80::fc16:3eff:feb8:922f', 'fe80::58aa:a8ff:fe4a:40f2', 'fe80::fc16:3eff:fe10:61df', 'fe80::fc16:3eff:fe8b:ae47', 'fe80::2c4f:25ff:fe37:4722', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb', 'fe80::fc16:3eff:feb9:51f5', 'fe80::fc16:3eff:fe37:990', 'fe80::84b:3cff:feeb:b861'] 
May 26 04:59:57.670649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:59:57.670800 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:59:57.671172 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:57.671883 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating existing volume attachment record: c1737d44-1a79-4ba8-97cd-13337c087613 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 04:59:57.704219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-19ff5a56-c316-43c3-8cee-bb48028984ae tempest-ServersNegativeTestJSON-1974443015 tempest-ServersNegativeTestJSON-1974443015-project-member] Lock "6b3962c4-d73d-4c08-a0bf-751265f8b607" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.117s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:57.736223 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updated VIF entry in instance network info cache for port af02a518-4683-4fb9-88cb-e597d6024a76. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:57.736952 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:57.752840 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:57.875479 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005441890000383864 future=<Future at 0x7d7aa445bdd0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.876986 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Emitting event <LifecycleEvent: 1779771582.8747885, 7e0085ac-d343-4e32-85db-8489cbf3a677 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:57.877288 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.877568 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] VM Stopped (Lifecycle Event)
May 26 04:59:57.880422 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.005076792999943791 future=<Future at 0x7d7aa45dfbc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.880682 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.005376014000148643 future=<Future at 0x7d7aa45dfbc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.880788 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.880909 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.448454622999861 future=<Future at 0x7d7aa446e780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.882054 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Emitting event <LifecycleEvent: 1779771582.8752396, 595593d5-7b8b-4177-a99e-d29c31010070 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 04:59:57.883218 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.4470635129998755 future=<Future at 0x7d7aa446e780 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 04:59:57.883325 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] VM Stopped (Lifecycle Event)
May 26 04:59:57.993120 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:58.111305 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 04:59:58.239720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-90d3ee08-2570-414e-a7b3-91b52adb704e req-d5fa191b-8214-47d2-936c-ab4aea405a76 service nova] Releasing lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:58.248042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:58.287223 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updated VIF entry in instance network info cache for port 1864280c-210d-4b7c-98d4-011d3c95285a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 04:59:58.287223 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updating instance_info_cache with network_info: [{"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 04:59:58.382832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 7e0085ac-d343-4e32-85db-8489cbf3a677] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:58.386996 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 595593d5-7b8b-4177-a99e-d29c31010070] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 04:59:58.477251 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 04:59:58.495456 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Releasing lock "refresh_cache-8d835b9c-8a58-4b53-9235-c49e96173d32" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:58.495844 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:58.511501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 04:59:58.536857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 04:59:58.572847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 04:59:58.574120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 04:59:58.591882 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 04:59:58.594057 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe55:64fe', 'fe80::d4b4:38ff:fe98:dac2', 'fe80::fc16:3eff:fe4c:5822', 'fe80::fc16:3eff:fed7:218f', 'fe80::fc16:3eff:fe03:14a3', 'fe80::fc16:3eff:feb8:922f', 'fe80::58aa:a8ff:fe4a:40f2', 'fe80::fc16:3eff:fe10:61df', 'fe80::fc16:3eff:fe8b:ae47', 'fe80::2c4f:25ff:fe37:4722', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb', 'fe80::fc16:3eff:feb9:51f5', 'fe80::fc16:3eff:fe37:990', 'fe80::84b:3cff:feeb:b861'] 
May 26 04:59:58.594338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 04:59:58.594487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 04:59:58.594700 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 04:59:58.787705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a3bdaea-5559-45f2-a14d-4fa28d9b8749 req-a9249212-e753-49df-9aaa-1bb68ae72f79 service nova] Releasing lock "refresh_cache-ecc66071-7d58-4b53-ad30-1b259d40f744" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 04:59:59.695728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Starting finish_revert_migration {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12932}}
May 26 04:59:59.711799 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start _get_guest_xml network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '506b9da3-35cd-4bcc-a79e-08c67d888fdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '8d835b9c-8a58-4b53-9235-c49e96173d32', 'attached_at': '2026-05-26T04:59:59.000000', 'detached_at': '', 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'serial': '575b9d98-8caa-44b9-814a-7e29ce2fc18b'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:59.714889 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:59.716707 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-1700156257', uuid='8d835b9c-8a58-4b53-9235-c49e96173d32'), owner=OwnerMeta(userid='e403f092f91b47c1b1e6664b4f806bd2', username='tempest-ServerActionsTestOtherB-517547792-project-member', projectid='3e44351e7dfd4870bf0073b5f95c0423', projectname='tempest-ServerActionsTestOtherB-517547792'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771599.7161257) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:59.718005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:59.718459 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:59.719306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:59.719562 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:59.720697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:59.721080 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:59.721294 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:59.721417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:59.721563 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:59.721673 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:59.721813 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:59.722047 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:59.722203 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:59.722407 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:59.722553 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:59.722718 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:59.723040 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 04:59:59.852595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 04:59:59.853823 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 04:59:59.854524 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Creating image(s)
May 26 04:59:59.856567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 04:59:59.856567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Ensure instance console log exists: /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 04:59:59.856825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 04:59:59.857066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 04:59:59.857298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 04:59:59.857981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start _get_guest_xml network_info=[{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'c1737d44-1a79-4ba8-97cd-13337c087613', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '66b166c9-35a8-471b-80c3-a1bfdd60b26b', 'attached_at': '', 'detached_at': '', 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'serial': '6704aebd-739b-4cf9-aee6-37b702975722'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 04:59:59.860262 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 04:59:59.861219 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651', uuid='66b166c9-35a8-471b-80c3-a1bfdd60b26b'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771599.8609285) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 04:59:59.864924 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 04:59:59.867576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 04:59:59.867576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 04:59:59.868520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 04:59:59.869455 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 04:59:59.871495 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 04:59:59.871845 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 04:59:59.872753 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 04:59:59.872753 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 04:59:59.873242 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 04:59:59.873397 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 04:59:59.874089 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 04:59:59.874089 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 04:59:59.874089 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 04:59:59.874252 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 04:59:59.874357 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 04:59:59.888349 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 04:59:59.888349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 04:59:59.888529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:59.888923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:59.889139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 04:59:59.906296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:59.909119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 04:59:59.909119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:59.909119 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 04:59:59.909119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 04:59:59.909390 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 04:59:59.924509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:59.924509 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:59.931962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 04:59:59.931962 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:59.942720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722] added
May 26 04:59:59.942720 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:59.942720 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:59.942720 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:59.942720 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:59.942720 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:59.942720 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:59.943594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:59.943594 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0348(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:59.943594 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 04:59:59.952262 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722] added
May 26 04:59:59.952262 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 04:59:59.952262 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:59.952262 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:59.952262 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 04:59:59.952262 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 04:59:59.952262 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 04:59:59.953135 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 04:59:59.953135 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 04:59:59.953135 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:00.021235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:00.257859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:00.346100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:00.347018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:00.347546 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:00.349091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:00.349586 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:00.350049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:00.350517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:00.944587 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:00.955432 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:00.967692 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:00.967692 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:00.978424 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:00.978424 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:00.988257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:01.000840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.013414 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.027699 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:01.081170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.40.100,3260]
May 26 05:00:01.081170 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.40.100,3260] successful.
May 26 05:00:01.081170 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:01.102285 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.137874 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:01.138216 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:01.138769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.230s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:01.138769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:01.140509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('15', '-', '-', 0) found on session 23 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:01.142151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:01.196889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 23 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:01.196889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:01.263438 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:01.664469 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:01.920684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:01.920684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:02.096398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.50.100,3260]
May 26 05:00:02.096398 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.50.100,3260] successful.
May 26 05:00:02.096398 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:02.125814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:02.155501 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:02.156359 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:02.156780 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.249s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:02.157287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:02.158511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('16', '-', '-', 0) found on session 24 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:02.158678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:02.200236 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 24 and hctl ['16', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:02.426236 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:00:03.018225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:03.018225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:03.022890 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:00:03.023822 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Claim successful on node np0000001388
May 26 05:00:03.200851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 24 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:03.201532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:03.249184 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:03.329952 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00043656100001499 future=<Future at 0x7d7aa446e780 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.330078 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.330281 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.0005026220001127513 future=<Future at 0x7d7ac43cadb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.330376 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.0003471600000466424 future=<Future at 0x7d7ac43cadb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.332161 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.001141834000009112 future=<Future at 0x7d7ac43cadb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.332161 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:03.333781 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Emitting event <LifecycleEvent: 1779771588.3292832, 6b3962c4-d73d-4c08-a0bf-751265f8b607 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:03.334374 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] VM Stopped (Lifecycle Event)
May 26 05:00:03.335586 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Emitting event <LifecycleEvent: 1779771588.3306186, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:03.336797 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Stopped (Lifecycle Event)
May 26 05:00:03.837150 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 6b3962c4-d73d-4c08-a0bf-751265f8b607] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:03.838989 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:04.053120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Found WWN 1StorPooliSCSI_DISK_1034578903445798947 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:04.053562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:04.053912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== connect_volume: return (4165ms) {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798947', 'path': '/dev/dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798947'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:04.054106 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '1StorPooliSCSI_DISK_1034578903445798947', 'path': '/dev/dm-3', 'multipath_id': '1StorPooliSCSI_DISK_1034578903445798947'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:04.055570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.705s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:04.056894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:04.072085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:04.073235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:04.073955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:04.074621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:04.074921 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:04.075240 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:04.095176 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:04.095176 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:04.105707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:04.105707 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:04.118002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 05:00:04.118002 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:04.118002 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:04.118002 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:04.118002 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:04.118002 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:04.118002 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:04.118703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:04.118703 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0434(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:04.118703 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:04.122765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b] added
May 26 05:00:04.122765 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:04.122765 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:04.122765 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:04.122765 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:04.122765 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:04.122765 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:04.123139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:04.123139 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0485(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:04.123424 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:04.569744 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-197280651',id=15,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-px15w3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:53Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=66b166c9-35a8-471b-80c3-a1bfdd60b26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:04.570397 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:04.570656 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:04.571359 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:04.719481 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:04.720753 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:05.075802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <uuid>66b166c9-35a8-471b-80c3-a1bfdd60b26b</uuid>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <name>instance-0000000f</name>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-197280651</nova:name>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:59</nova:creationTime>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         <nova:port uuid="af02a518-4683-4fb9-88cb-e597d6024a76">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="serial">66b166c9-35a8-471b-80c3-a1bfdd60b26b</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="uuid">66b166c9-35a8-471b-80c3-a1bfdd60b26b</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <alias name="ua-6704aebd-739b-4cf9-aee6-37b702975722"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <serial>6704aebd-739b-4cf9-aee6-37b702975722</serial>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:86:ac:76"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <target dev="tapaf02a518-46"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/console.log" append="off"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:05.075802 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:05.078470 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Preparing to wait for external event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:00:05.078470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:05.078470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:05.078470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:05.079579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T04:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-197280651',id=15,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-px15w3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T04:59:53Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=66b166c9-35a8-471b-80c3-a1bfdd60b26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:00:05.079579 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:05.080094 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:05.080283 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:00:05.081285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:05.081285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:05.081285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:00:05.084900 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:05.084900 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb66de16-1845-5ac8-94ed-669f2bdb905c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:05.088339 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:05.091869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:05.092815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf02a518-46, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:05.093057 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf02a518-46, col_values=(('qos', UUID('0d98e327-750c-4ce9-b7a8-d89a099fdd5d')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:05.093264 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf02a518-46, col_values=(('external_ids', {'iface-id': 'af02a518-4683-4fb9-88cb-e597d6024a76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:ac:76', 'vm-uuid': '66b166c9-35a8-471b-80c3-a1bfdd60b26b'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:05.096219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:05.102872 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:05.104021 np0000001388 nova-compute[98319]: INFO os_vif [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46')
May 26 05:00:05.120424 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:05.126401 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:05.140625 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:05.140625 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:05.148611 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:05.148611 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.163742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.173560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.186917 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.187482 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.195894 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.196291 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:05.222471 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:05.251954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 05:00:05.251954 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 05:00:05.251954 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.265762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 05:00:05.265762 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 05:00:05.265762 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.266411 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.289695 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.301131 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.301684 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:05.302030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:05.302244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:05.304066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('17', '-', '-', 0) found on session 25 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:05.305812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.314741 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:05.315518 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.241s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:05.315518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:05.318132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] HCTL ('18', '-', '-', 0) found on session 26 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:05.318132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:05.333757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 25 and hctl ['17', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:05.353485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 26 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:05.353485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:05.734374 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.716s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:05.734957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:00:06.243504 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:00:06.243504 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:00:06.243785 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:06.244213 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:06.334702 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Searching for a device in session 25 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:06.334911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:06.352925 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2cfd0a85086451e85699b0f631b52ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d5b058d94fd42eeaf1703daec3f3d46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:00:06.627232 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:06.627232 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:06.627232 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:86:ac:76, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:06.627232 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Using config drive
May 26 05:00:06.662964 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:06.748911 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
May 26 05:00:07.073040 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Successfully created port: 70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:00:07.102954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Found WWN 3300000007d246083 for multipath device dm-9 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:07.103885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:07.104223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== connect_volume: return (6753ms) {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-9', 'multipath_id': '3300000007d246083'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:07.105142 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007d246083', 'path': '/dev/dm-9', 'multipath_id': '3300000007d246083'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:07.139652 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:07.256367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:00:07.611612 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:41Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:07.611767 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:07.613434 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:07.617422 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <uuid>8d835b9c-8a58-4b53-9235-c49e96173d32</uuid>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <name>instance-00000003</name>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherB-server-1700156257</nova:name>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 04:59:59</nova:creationTime>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:user uuid="e403f092f91b47c1b1e6664b4f806bd2">tempest-ServerActionsTestOtherB-517547792-project-member</nova:user>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:project uuid="3e44351e7dfd4870bf0073b5f95c0423">tempest-ServerActionsTestOtherB-517547792</nova:project>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         <nova:port uuid="a1df6515-d249-4964-8dc0-e810a2fa8446">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="serial">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="uuid">8d835b9c-8a58-4b53-9235-c49e96173d32</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/disk.config"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <alias name="ua-575b9d98-8caa-44b9-814a-7e29ce2fc18b"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-9"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <serial>575b9d98-8caa-44b9-814a-7e29ce2fc18b</serial>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:31:f0:b0"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <target dev="tapa1df6515-d2"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32/console.log" append="off"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:07.617422 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Preparing to wait for external event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:41Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:07.622273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:00:07.624750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.624750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a69b89bf-87f7-54f0-b3ec-5b7d0d7e0e02', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:07.625633 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.626495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:07.633614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.639442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.639937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1df6515-d2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:07.639937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1df6515-d2, col_values=(('qos', UUID('29bec29f-1273-4760-b88f-8bef0e328f57')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:07.640117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1df6515-d2, col_values=(('external_ids', {'iface-id': 'a1df6515-d249-4964-8dc0-e810a2fa8446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:f0:b0', 'vm-uuid': '8d835b9c-8a58-4b53-9235-c49e96173d32'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:07.641837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.643496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:07.658767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:07.659979 np0000001388 nova-compute[98319]: INFO os_vif [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 05:00:07.686049 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Creating config drive at /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config
May 26 05:00:07.697164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw36e3h_n {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:07.763240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpw36e3h_n" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:07.980133 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Successfully updated port: 70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:00:08.062930 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-changed-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:08.063152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Refreshing instance network info cache due to event network-changed-70888df7-6950-48f1-b043-8b1671d5bd88. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:00:08.064466 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] Acquiring lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:08.064579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] Acquired lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:08.064747 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Refreshing network info cache for port 70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:00:08.278649 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:00:08.282306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:00:08.284832 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Creating image(s)
May 26 05:00:08.284832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:08.284832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:08.284832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:08.284832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:08.285222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:08.487471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:08.571900 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:08.687676 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:00:08.758510 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:08.801644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:08.958743 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.008457 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.070169 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:09.167080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.302046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.328990 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.458187 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:09.469410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.475530 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:09.475530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:09.504245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.575928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7589256-24bf-446d-8147-03da098ac1c4 req-909646a3-e9e9-44b2-9a6d-b71ed84b5349 service nova] Releasing lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:09.576658 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquired lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:09.576658 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:00:09.630128 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.part --force-share --output=json" returned: 0 in 0.155s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:09.630128 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] e1841b1f-f5b7-45e7-9250-16607f4d86f7 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:00:09.631373 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:00:09.631898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.part /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:09.843652 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a24392c4-18b9-4156-b72a-7c1e2444ca00 req-2d3b0d79-a15a-428b-b3d7-b2e7d2762532 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:09.843652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a24392c4-18b9-4156-b72a-7c1e2444ca00 req-2d3b0d79-a15a-428b-b3d7-b2e7d2762532 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:09.843652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a24392c4-18b9-4156-b72a-7c1e2444ca00 req-2d3b0d79-a15a-428b-b3d7-b2e7d2762532 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:09.843652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a24392c4-18b9-4156-b72a-7c1e2444ca00 req-2d3b0d79-a15a-428b-b3d7-b2e7d2762532 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:09.843652 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a24392c4-18b9-4156-b72a-7c1e2444ca00 req-2d3b0d79-a15a-428b-b3d7-b2e7d2762532 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Processing event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:00:09.915831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.919049 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:09.966129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.part /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.converted" returned: 0 in 0.334s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:09.978460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.103455 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c.converted --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.104579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.819s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:10.105146 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:10.109303 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:10.112921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.194757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:10.194900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:10.195110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:10.195175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:10.196192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Processing event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:00:10.196192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:10.196192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:10.196192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:10.196192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:10.196545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:10.196687 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6f482fca-0d4b-4594-a339-b1ec4dd8b51e req-a095b8a6-d635-4d5a-b9af-8de99ca66433 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state resized and task_state resize_reverting.
May 26 05:00:10.239281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json" returned: 0 in 0.126s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.239724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:10.240255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:10.240764 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:10.248392 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:10.248392 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.265408 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:00:10.350578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.351158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c,backing_fmt=raw /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.412307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c,backing_fmt=raw /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk 1073741824" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.413706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "2441a40c61ff9d1c8766905e16c956742fe0d27c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:10.415239 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.500818 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771610.5000536, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:10.501591 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Started (Lifecycle Event)
May 26 05:00:10.503802 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:00:10.504931 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:00:10.511434 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:00:10.514152 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance running successfully.
May 26 05:00:10.517288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] finish_revert_migration finished successfully. {{(pid=98319) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12978}}
May 26 05:00:10.521433 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance spawned successfully.
May 26 05:00:10.522067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2441a40c61ff9d1c8766905e16c956742fe0d27c --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.523797 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:00:10.528522 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:00:10.528893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:10.593874 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:10.647134 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:10.648410 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Cannot resize image /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:00:10.648670 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:00:10.648991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Ensure instance console log exists: /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:00:10.649488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:10.650056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:10.650056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:10.794260 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating instance_info_cache with network_info: [{"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:11.009376 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:11.013516 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:11.040996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.040996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.040996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.040996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.043450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.043913 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:11.298608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Releasing lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:11.298705 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance network_info: |[{"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:00:11.301305 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Start _get_guest_xml network_info=[{"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:59:56Z,direct_url=<?>,disk_format='qcow2',id=e1841b1f-f5b7-45e7-9250-16607f4d86f7,min_disk=0,min_ram=0,name='',owner='031d05117cc84c01bd3601c0474336be',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:59:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'disk_bus': 'scsi', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/sda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'e1841b1f-f5b7-45e7-9250-16607f4d86f7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:00:11.306603 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:00:11.312387 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='e1841b1f-f5b7-45e7-9250-16607f4d86f7', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-92465715', uuid='08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554'), owner=OwnerMeta(userid='a2cfd0a85086451e85699b0f631b52ea', username='tempest-AttachSCSIVolumeTestJSON-1972919827-project-member', projectid='3d5b058d94fd42eeaf1703daec3f3d46', projectname='tempest-AttachSCSIVolumeTestJSON-1972919827'), image=ImageMeta(id='e1841b1f-f5b7-45e7-9250-16607f4d86f7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771611.3110263) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:00:11.315853 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:00:11.315853 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:00:11.317574 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:00:11.318277 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:00:11.319236 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:59:56Z,direct_url=<?>,disk_format='qcow2',id=e1841b1f-f5b7-45e7-9250-16607f4d86f7,min_disk=0,min_ram=0,name='',owner='031d05117cc84c01bd3601c0474336be',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:59:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:00:11.321435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:00:11.322138 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:00:11.322322 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:00:11.347435 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-92465715',display_name='tempest-AttachSCSIVolumeTestJSON-server-92465715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachscsivolumetestjson-server-92465715',id=16,image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPReL6KKQM8WPVg1ZkI4f4mdOJpnvunDuAv0/vtDKfAExiq0fn3N+TM263xekrUPkKrUMLA0/s4n8AHAii/cHubf2y6tD8FAoFYaH7S+kIFvSxBNU6Dd5H2kHzUaJILiGg==',key_name='tempest-keypair-1363675201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d5b058d94fd42eeaf1703daec3f3d46',ramdisk_id='',reservation_id='r-9rtwctdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972919827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972919827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2cfd0a85086451e85699b0f631b52ea',uuid=08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:11.347779 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converting VIF {"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:11.348654 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:11.349411 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lazy-loading 'pci_devices' on Instance uuid 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:11.518491 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] During sync_power_state the instance has a pending task (resize_reverting). Skip.
May 26 05:00:11.518798 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771611.518582, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:11.518969 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Paused (Lifecycle Event)
May 26 05:00:11.552821 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Took 11.70 seconds to spawn the instance on the hypervisor.
May 26 05:00:11.553330 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:11.600690 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f82dbcaa-d251-4978-afb2-f3e77ab5d56b tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance to original state: 'active'
May 26 05:00:11.665762 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.856077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <uuid>08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554</uuid>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <name>instance-00000010</name>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-92465715</nova:name>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:00:11</nova:creationTime>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:image uuid="e1841b1f-f5b7-45e7-9250-16607f4d86f7">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">scsi</nova:property>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">scsi</nova:property>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:           <nova:property name="hw_scsi_model">virtio-scsi</nova:property>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:user uuid="a2cfd0a85086451e85699b0f631b52ea">tempest-AttachSCSIVolumeTestJSON-1972919827-project-member</nova:user>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:project uuid="3d5b058d94fd42eeaf1703daec3f3d46">tempest-AttachSCSIVolumeTestJSON-1972919827</nova:project>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="e1841b1f-f5b7-45e7-9250-16607f4d86f7"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         <nova:port uuid="70888df7-6950-48f1-b043-8b1671d5bd88">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="serial">08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="uuid">08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <target dev="sda" bus="scsi"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <address type="drive" controller="0" unit="0"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.config"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <target dev="sdb" bus="scsi"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <address type="drive" controller="0" unit="1"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <controller type="scsi" index="0" model="virtio-scsi"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:4f:77:99"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <target dev="tap70888df7-69"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/console.log" append="off"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:11.856077 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Preparing to wait for external event network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-92465715',display_name='tempest-AttachSCSIVolumeTestJSON-server-92465715',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachscsivolumetestjson-server-92465715',id=16,image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPReL6KKQM8WPVg1ZkI4f4mdOJpnvunDuAv0/vtDKfAExiq0fn3N+TM263xekrUPkKrUMLA0/s4n8AHAii/cHubf2y6tD8FAoFYaH7S+kIFvSxBNU6Dd5H2kHzUaJILiGg==',key_name='tempest-keypair-1363675201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d5b058d94fd42eeaf1703daec3f3d46',ramdisk_id='',reservation_id='r-9rtwctdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972919827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972919827-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2cfd0a85086451e85699b0f631b52ea',uuid=08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converting VIF {"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:11.861281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:00:11.862261 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.862475 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17192818-2897-536e-b725-0ca88a1794ac', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:11.866347 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.870439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:11.873376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.874012 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap70888df7-69, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:11.875227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap70888df7-69, col_values=(('qos', UUID('cd87025d-7b61-46be-b659-37ad418ec94f')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:11.876010 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap70888df7-69, col_values=(('external_ids', {'iface-id': '70888df7-6950-48f1-b043-8b1671d5bd88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:77:99', 'vm-uuid': '08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:11.877265 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.880642 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:11.887558 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:11.888989 np0000001388 nova-compute[98319]: INFO os_vif [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69')
May 26 05:00:11.923632 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:11.924012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:11.924247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:11.924351 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:11.924517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:11.924677 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6753d6ea-8586-4fcc-8921-eff71c6b2c4a req-36387e91-24e5-4500-b9b3-dec8a448a9bd service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state None.
May 26 05:00:12.023359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:12.024986 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771612.024606, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:12.025217 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Started (Lifecycle Event)
May 26 05:00:12.066569 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Took 24.38 seconds to build instance.
May 26 05:00:12.527960 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:12.529987 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:12.569136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.912s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:13.038409 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771613.0336652, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:13.038409 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Paused (Lifecycle Event)
May 26 05:00:13.415491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No BDM found with device name sda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:13.415491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:13.415491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No VIF found with MAC fa:16:3e:4f:77:99, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:13.415491 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Using config drive
May 26 05:00:13.543012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:13.548222 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771613.5478888, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:13.548387 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Resumed (Lifecycle Event)
May 26 05:00:13.606632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:13.606805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:13.606994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:13.607219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:13.607356 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:13.612304 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Terminating instance
May 26 05:00:13.656446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:13.923730 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:14.051651 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:14.056091 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:14.115318 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Creating config drive at /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.config
May 26 05:00:14.120457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvyku_0y6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:14.140851 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:14.184228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.188466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.197069 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvyku_0y6" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:14.208949 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.221644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.260848 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.432008 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Rescuing
May 26 05:00:14.432382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:14.434981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:14.434981 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:00:14.440596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:14.442440 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:14.443626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:14.444843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:14.445108 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:14.445351 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b9c11e48-c0af-4139-b654-2ad2c03b3362 req-1d93fbab-a5d4-489b-86ec-c4b0bc541b04 service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:14.562699 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] During sync_power_state the instance has a pending task (deleting). Skip.
May 26 05:00:14.563996 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771614.5629678, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:14.563996 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Resumed (Lifecycle Event)
May 26 05:00:14.749944 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.801061 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Instance destroyed successfully.
May 26 05:00:14.804126 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lazy-loading 'resources' on Instance uuid 8d835b9c-8a58-4b53-9235-c49e96173d32 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:14.804286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.847122 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.945396 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:14.957567 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:14.999818 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.009805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.068475 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:15.079263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:15.116930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.266040 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.267937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.294930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.301472 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.309975 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1700156257',display_name='tempest-ServerActionsTestOtherB-server-1700156257',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestotherb-server-1700156257',id=3,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBfn1fYsM6cZBhPdAeLWYUdSdoMnx5AudClO+wU8+OVewCarIjVTqSEzaLWmNBp2UuPUVDKREnmHXd0gHIwuYMLPCciUH8ytSNYM9rOELYL+fJiTnv7HPrkMPgT0KeLtfQ==',key_name='tempest-keypair-882874437',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3e44351e7dfd4870bf0073b5f95c0423',ramdisk_id='',reservation_id='r-xzrnjhn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-517547792',owner_user_name='tempest-ServerActionsTestOtherB-517547792-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:00:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e403f092f91b47c1b1e6664b4f806bd2',uuid=8d835b9c-8a58-4b53-9235-c49e96173d32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:15.310175 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converting VIF {"id": "a1df6515-d249-4964-8dc0-e810a2fa8446", "address": "fa:16:3e:31:f0:b0", "network": {"id": "4477dc56-85e8-43d4-97a5-be01180a49a2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2047413984-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3e44351e7dfd4870bf0073b5f95c0423", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1df6515-d2", "ovs_interfaceid": "a1df6515-d249-4964-8dc0-e810a2fa8446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:15.312425 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:15.312425 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:15.312692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.313683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1df6515-d2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:15.315959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.315959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:15.315959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.318255 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.318413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29bec29f-1273-4760-b88f-8bef0e328f57) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:15.319626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.320693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:15.322828 np0000001388 nova-compute[98319]: INFO os_vif [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:f0:b0,bridge_name='br-int',has_traffic_filtering=True,id=a1df6515-d249-4964-8dc0-e810a2fa8446,network=Network(4477dc56-85e8-43d4-97a5-be01180a49a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1df6515-d2')
May 26 05:00:15.326071 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:15.329219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:15.329219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:15.329219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:15.329219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '575b9d98-8caa-44b9-814a-7e29ce2fc18b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:15.329219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:15.344416 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d28c2916-f65e-46ff-8a4f-14a6adeaca71 req-3e2e2145-5882-4b47-9208-71898b57a053 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:15.344416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d28c2916-f65e-46ff-8a4f-14a6adeaca71 req-3e2e2145-5882-4b47-9208-71898b57a053 service nova] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:15.344581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d28c2916-f65e-46ff-8a4f-14a6adeaca71 req-3e2e2145-5882-4b47-9208-71898b57a053 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:15.344897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d28c2916-f65e-46ff-8a4f-14a6adeaca71 req-3e2e2145-5882-4b47-9208-71898b57a053 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:15.345487 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d28c2916-f65e-46ff-8a4f-14a6adeaca71 req-3e2e2145-5882-4b47-9208-71898b57a053 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Processing event network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:15.377634 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [26] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:15.380731 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '25'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '26'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '26')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:15.380731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b', '25')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:15.381510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46d87c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'): ({'sdl'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:15.381804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Removing multipathed devices sdl, sdm {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:15.382091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Flush multipath device 3300000007d246083 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:15.426673 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:15.446610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.451102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.470321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:15.474521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.515482 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:15.530925 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:15.531109 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:15.533116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:15.545897 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:15.546123 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:15.562258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.587371 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] During sync_power_state the instance has a pending task (rescuing). Skip.
May 26 05:00:15.587371 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999807329000078 future=<Future at 0x7d7aa443f410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:15.587371 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999621310000066 future=<Future at 0x7d7aa443f410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:15.587371 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999505252000063 future=<Future at 0x7d7aa443f410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:15.609009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260]
May 26 05:00:15.609009 np0000001388 nova-compute[98319]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.40.100,3260] successful.
May 26 05:00:15.609009 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.618957 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:15.619183 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 26 05:00:15.638555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.666300 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.706359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260]
May 26 05:00:15.706359 np0000001388 nova-compute[98319]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-575b9d98-8caa-44b9-814a-7e29ce2fc18b, portal: 192.168.50.100,3260] successful.
May 26 05:00:15.706359 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.733388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:15.733652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:15.733815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] <== disconnect_volume: return (407ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:15.733984 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:15.734358 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Deleting instance files /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_del
May 26 05:00:15.745938 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Deletion of /opt/stack/data/nova/instances/8d835b9c-8a58-4b53-9235-c49e96173d32_del complete
May 26 05:00:15.778441 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:15.967513 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.970797 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:15.974744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:16.005781 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:16.108027 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:00:16.109982 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771616.1083488, 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:16.109982 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] VM Started (Lifecycle Event)
May 26 05:00:16.113403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:00:16.116857 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance spawned successfully.
May 26 05:00:16.117493 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:00:16.123544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:16.123544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:16.123544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:16.123544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:16.128173 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 26 05:00:16.133375 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:16.133375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 26 05:00:16.257374 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Took 2.12 seconds to destroy the instance on the hypervisor.
May 26 05:00:16.258656 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:16.258656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:16.258656 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:16.258823 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:16.281827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:16.373760 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:16.516070 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:16.516255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:16.516428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:16.516580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:16.516784 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:16.516876 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:16.517070 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:16.517268 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:16.517509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:16.517509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:16.517794 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:16.517794 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state active and task_state deleting.
May 26 05:00:16.517990 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:16.519390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received unexpected event network-vif-plugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with vm_state active and task_state deleting.
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:16.521231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:16.523401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:16.524133 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:16.524461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:16.524461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:16.524589 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:16.525053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Acquiring lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:16.525053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:16.525053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:16.525302 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] No waiting events found dispatching network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:16.527598 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58ce31d8-28ee-4933-930b-536128162f10 req-05a6dbc0-814a-47ef-ab10-498d25f42ece service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-unplugged-a1df6515-d249-4964-8dc0-e810a2fa8446 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:16.614680 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:16.624501 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:16.633379 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Took 8.35 seconds to spawn the instance on the hypervisor.
May 26 05:00:16.633711 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:16.634707 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:16.670489 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:17.127422 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:00:17.129888 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771617.1282117, 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:17.129888 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] VM Paused (Lifecycle Event)
May 26 05:00:17.137418 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:00:17.141047 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0cc2add4-e71e-4d09-b8b0-5a63631472c7 req-d0691752-1a4b-40e3-98db-873c208ae70f service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Received event network-vif-deleted-a1df6515-d249-4964-8dc0-e810a2fa8446 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:17.141272 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-0cc2add4-e71e-4d09-b8b0-5a63631472c7 req-d0691752-1a4b-40e3-98db-873c208ae70f service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Neutron deleted interface a1df6515-d249-4964-8dc0-e810a2fa8446; detaching it from the instance and deleting it from the info cache
May 26 05:00:17.141380 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0cc2add4-e71e-4d09-b8b0-5a63631472c7 req-d0691752-1a4b-40e3-98db-873c208ae70f service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:17.149911 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Took 14.22 seconds to build instance.
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] No waiting events found dispatching network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:17.433756 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e2b1001b-b33d-4364-98a0-2e9ac99f2861 req-1f47e50c-21c9-4ae6-a827-43499626f92f service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received unexpected event network-vif-plugged-70888df7-6950-48f1-b043-8b1671d5bd88 for instance with vm_state active and task_state None.
May 26 05:00:17.575499 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:17.631596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:17.635099 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771617.6336594, 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:17.635099 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] VM Resumed (Lifecycle Event)
May 26 05:00:17.648771 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0cc2add4-e71e-4d09-b8b0-5a63631472c7 req-d0691752-1a4b-40e3-98db-873c208ae70f service nova] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Detach interface failed, port_id=a1df6515-d249-4964-8dc0-e810a2fa8446, reason: Instance 8d835b9c-8a58-4b53-9235-c49e96173d32 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:17.651911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.733s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:17.974587 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.003790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.077958 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Took 1.82 seconds to deallocate network for instance.
May 26 05:00:18.136706 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:18.141490 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:18.191633 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.266292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.269541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.301370 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance destroyed successfully.
May 26 05:00:18.301867 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'numa_topology' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:18.316687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:18.316893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:18.317850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:18.317850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:18.317850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:18.325878 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Terminating instance
May 26 05:00:18.587045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-changed-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:18.587315 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Refreshing instance network info cache due to event network-changed-70888df7-6950-48f1-b043-8b1671d5bd88. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:00:18.587516 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] Acquiring lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:18.587626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] Acquired lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:18.587768 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Refreshing network info cache for port 70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:00:18.642889 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99975676400004 future=<Future at 0x7d7ac43dfdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:18.669929 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Took 0.59 seconds to detach 1 volumes for instance.
May 26 05:00:18.806619 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Attempting a stable device rescue
May 26 05:00:18.830534 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:18.868772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.872584 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.902112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.916722 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.924771 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 05:00:18.934571 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:00:18.934762 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Creating image(s)
May 26 05:00:18.935272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:18.935420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:18.935849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:18.936037 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'trusted_certs' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:18.938171 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.972892 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:18.981543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.020475 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:19.020800 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:19.020912 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:19.021117 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:19.021359 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:19.021986 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.60 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:00:19.081243 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.092545 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:19.133404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.179501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:19.179923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:19.183316 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:19.206297 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.263394 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.265479 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Deleted allocations for instance 8d835b9c-8a58-4b53-9235-c49e96173d32
May 26 05:00:19.308765 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.334033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.418572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.438900 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:19.439290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:19.440590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:19.555480 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999692132000064 future=<Future at 0x7d7aec149340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:19.558533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.567271 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Instance destroyed successfully.
May 26 05:00:19.567271 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lazy-loading 'resources' on Instance uuid 0d47d0b8-fefe-4218-9bd0-08c318e7484a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:19.594428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.649118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:19.818450 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:20.027948 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updated VIF entry in instance network info cache for port 70888df7-6950-48f1-b043-8b1671d5bd88. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:00:20.030299 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating instance_info_cache with network_info: [{"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:20.070061 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.070466 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.071258 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.071581 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.074987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.075469 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7ef8ccb-c5, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.078309 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.079849 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.128632 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.131464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.132250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3698f204-07aa-4321-ab76-22b7a8def1c8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.132987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.134333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.173763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.176031 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:64:fe,bridge_name='br-int',has_traffic_filtering=True,id=a7ef8ccb-c585-4d52-821d-9625a7566f42,network=Network(b3ed0483-bfe2-473b-945a-83f2eedaf398),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7ef8ccb-c5')
May 26 05:00:20.176917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.177172 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.178025 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.178025 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.179561 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.179962 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d7b6098-37, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.181299 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.182416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.224061 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.225685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.225953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a525df5-b6e0-440f-a94e-45073f5541c1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.229671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.265021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.267851 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:58:22,bridge_name='br-int',has_traffic_filtering=True,id=3d7b6098-3764-4de0-91cb-6a6ceb63e326,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3d7b6098-37')
May 26 05:00:20.268782 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.268969 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.269571 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.269812 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.271012 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.271178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98a60a4c-e6, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.274160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.282656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21d35c71-f8d8-488a-920f-45ed6217c6af tempest-ServerActionsTestOtherB-517547792 tempest-ServerActionsTestOtherB-517547792-project-member] Lock "8d835b9c-8a58-4b53-9235-c49e96173d32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.674s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:20.301319 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.303344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.303578 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c52aa59a-cf78-4729-afc5-4a48e08b4b99) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.305661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.333810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.337137 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:21:8f,bridge_name='br-int',has_traffic_filtering=True,id=98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap98a60a4c-e6')
May 26 05:00:20.337850 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.338076 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "address": "fa:16:3e:03:14:a3", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e8369c-2a", "ovs_interfaceid": "43e8369c-2abf-41ee-8e75-e0471b3094a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.339875 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.340134 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.345032 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.353127 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.353563 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:20.364464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.365462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43e8369c-2a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.375365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.394735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.398512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.398685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3577e9a4-8de0-4066-a4f2-f417a465f2aa) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.399937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.400705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.433180 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.437229 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:14:a3,bridge_name='br-int',has_traffic_filtering=True,id=43e8369c-2abf-41ee-8e75-e0471b3094a2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e8369c-2a')
May 26 05:00:20.438097 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.440141 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.440141 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.440454 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.442033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.442388 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2b9c11dd-15, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.444329 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.445358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.456187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.part --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:20.456856 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] b58eb172-4352-4e34-83e0-6f41cd499d52 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:00:20.457793 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:00:20.458148 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.part /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:20.474408 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.482413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.482825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2535ce05-7cbf-4cc7-a841-c5a7e4194c8b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.486806 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:20.489229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:20.489229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:20.489897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:20.493577 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.493577 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:20.493808 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d1aa3e0f-0d71-4a0f-a64b-9bdfc89ba371 req-4fca7f5d-a450-47e4-a985-e7bad1ce8657 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state rescuing.
May 26 05:00:20.504095 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.507140 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:92:2f,bridge_name='br-int',has_traffic_filtering=True,id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2,network=Network(0d7992de-672f-4c9e-bc68-0bda4359214b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2b9c11dd-15')
May 26 05:00:20.508707 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.508911 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.509850 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.510737 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.512233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.512530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30fae245-49, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.515346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.517561 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.528413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.530242 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.530327 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fb5df03-5c96-4352-8d0f-df0f65065901) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.531288 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.532522 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.533633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6c7c9428-3724-4fb2-a1ac-0ee2f40873b7 req-6bea398a-c4ee-4261-9581-825ed4fd4be8 service nova] Releasing lock "refresh_cache-08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:20.545060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.547351 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:61:df,bridge_name='br-int',has_traffic_filtering=True,id=30fae245-4921-4b63-a1d2-9f7b2a02b90e,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30fae245-49')
May 26 05:00:20.548128 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-290168394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-290168394',id=8,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP41UwZC66Edn/NRwIIs9/JzjD91JUFNmwumEwQ2tRgJbY6kH0/Z0mVc4VcVKjUO2puFX3aXoNa4OnXtaZa/VnvyLeV0bprChYbPjT1cn7ZcEfVZNi4v+WzVSW/lmwpHfw==',key_name='tempest-keypair-182544923',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a773253d42414a86a7ee9ed5a1939fdc',ramdisk_id='',reservation_id='r-arggd84o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1451569092',owner_user_name='tempest-TaggedBootDevicesTest-1451569092-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9381b603332a4888bbcde18a945c56a1',uuid=0d47d0b8-fefe-4218-9bd0-08c318e7484a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:20.548355 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converting VIF {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:20.548852 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:20.549076 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:20.550077 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.550478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap203a11b7-72, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.553053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.561046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.561046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.561046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37ed73ab-9e4f-4c57-a554-ee197ece6aaa) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:20.562704 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:20.570669 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:20.571899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.part /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.converted" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:20.573837 np0000001388 nova-compute[98319]: INFO os_vif [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:ae:47,bridge_name='br-int',has_traffic_filtering=True,id=203a11b7-726d-4b89-a085-71ee7033cf4b,network=Network(c7c3cd1d-cdc3-49da-946f-79a45cd0935d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap203a11b7-72')
May 26 05:00:20.576688 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:20.577153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:20.577365 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:20.577856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:20.578188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:20.578381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:20.580304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:20.618955 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:20.619770 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:20.620527 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:20.623436 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [10] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]: tcp: [9] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012 (non-flash)
May 26 05:00:20.623915 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:20.628259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:20.628259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '9')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:20.628259 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.99 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:00:20.629470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012', '10')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:20.630829 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aec092ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:20.631151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:20.631680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Flush multipath device 3300000009ec5764f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:20.683365 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:20.709059 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee.converted --force-share --output=json" returned: 0 in 0.128s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:20.711830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.271s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:20.713119 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.718319 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.724770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:20.725579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:20.726875 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.733731 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:20.734048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:20.759045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:20.837641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:20.837641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:20.842918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:20.860964 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:20.861974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:20.871604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:20.871604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee,backing_fmt=raw /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:20.884542 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:20.941045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.40.100,3260]
May 26 05:00:20.941045 np0000001388 nova-compute[98319]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.40.100,3260] successful.
May 26 05:00:20.941045 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:20.960861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4ffaaae1d10c262d65755ab98d54fa15220368ee,backing_fmt=raw /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.rescue" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:20.961970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "4ffaaae1d10c262d65755ab98d54fa15220368ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:20.962124 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'migration_context' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:20.982626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.001603 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.066300 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.50.100,3260]
May 26 05:00:21.066300 np0000001388 nova-compute[98319]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-9c8b09ab-5693-422c-93c6-0d2c6dbd3012, portal: 192.168.50.100,3260] successful.
May 26 05:00:21.066300 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.103297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.103297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.523s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:21.103297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== disconnect_volume: return (523ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:21.103297 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:21.105745 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:21.106303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:21.106540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:21.107885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:21.107885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:21.109491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.153104 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [11] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [12] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.153587 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:21.154043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:21.154043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '11')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:21.155918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6', '12')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:21.156817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43e11c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:21.156985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:21.157296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Flush multipath device 330000000d2f33010 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:21.200954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:21.252080 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:21.298610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:21.298825 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:21.299927 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:21.314258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:21.315030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:21.337372 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.381524 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.40.100,3260]
May 26 05:00:21.381524 np0000001388 nova-compute[98319]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.40.100,3260] successful.
May 26 05:00:21.381524 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.401850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.416171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.461844 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.50.100,3260]
May 26 05:00:21.461844 np0000001388 nova-compute[98319]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-f159b9f6-498a-4d19-a57a-adb7cf50d9e6, portal: 192.168.50.100,3260] successful.
May 26 05:00:21.461844 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.466307 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:21.466654 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:00:21.467486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start _get_guest_xml network_info=[{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:86:ac:76"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b58eb172-4352-4e34-83e0-6f41cd499d52', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'c1737d44-1a79-4ba8-97cd-13337c087613', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, 'status': 'reserved', 'instance': '66b166c9-35a8-471b-80c3-a1bfdd60b26b', 'attached_at': '', 'detached_at': '', 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'serial': '6704aebd-739b-4cf9-aee6-37b702975722'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:00:21.467660 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:21.481816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.482024 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:21.482241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== disconnect_volume: return (375ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:21.482382 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:21.483669 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:21.484062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:21.484235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:21.484642 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:21.484953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '449d1c79-8865-431b-8869-e8bacaa4c673', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:21.485122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.516868 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsi session list stdout=tcp: [13] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: tcp: [14] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:21.517160 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:21.517397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:21.517397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '13')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:21.518343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673', '14')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:21.519092 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aeda0cae0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:21.519321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Removing multipathed devices sdi, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:21.519648 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Flush multipath device 3300000005b4cff93 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:21.553155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:21.605257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:21.652783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:21.652783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:21.655438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:21.669772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:21.670723 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:21.675232 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:21.684633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.729951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.40.100,3260]
May 26 05:00:21.729951 np0000001388 nova-compute[98319]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.40.100,3260] successful.
May 26 05:00:21.729951 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.746866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.761772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.803183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.50.100,3260]
May 26 05:00:21.803183 np0000001388 nova-compute[98319]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-449d1c79-8865-431b-8869-e8bacaa4c673, portal: 192.168.50.100,3260] successful.
May 26 05:00:21.803183 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.820995 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:21.821336 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:21.821501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] <== disconnect_volume: return (336ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:21.821750 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:21.822109 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Deleting instance files /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a_del
May 26 05:00:21.822894 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Deletion of /opt/stack/data/nova/instances/0d47d0b8-fefe-4218-9bd0-08c318e7484a_del complete
May 26 05:00:21.969942 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:21.974122 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:00:21.976160 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651', uuid='66b166c9-35a8-471b-80c3-a1bfdd60b26b'), owner=OwnerMeta(userid='8d25c63261bb45f1bc8ab1e39768c377', username='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member', projectid='89f7e0bdf71e47a9b6de4e03f880f492', projectname='tempest-ServerBootFromVolumeStableRescueTest-343983155'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:86:ac:76"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771621.9756238) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:00:21.978149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:00:21.978149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:00:21.979666 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:00:21.979932 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:00:21.981285 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:00:21.981903 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:00:21.982010 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:00:21.982127 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:00:21.982326 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:00:21.982456 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:00:21.982593 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:00:21.982793 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:00:21.982951 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:00:21.983117 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:00:21.983271 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:00:21.983429 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:00:21.983624 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'vcpu_model' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:22.338970 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Took 3.51 seconds to destroy the instance on the hypervisor.
May 26 05:00:22.341117 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:22.341390 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:22.341580 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:22.342140 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:22.487110 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:22.511340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:22.605729 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:22.606517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:22.606517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:22.606631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:22.606703 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:22.606842 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state rescuing.
May 26 05:00:22.606952 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:22.607084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:22.607256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:22.607367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:22.607477 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:22.607644 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c226b62-5008-4070-9056-33eb96f71dab req-7288fa57-a300-4d29-bd22-fec60c6641f0 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:22.609870 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:22.610436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:22.610669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:22.611733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:22.612342 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:22.612794 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:22.613002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:22.613530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:22.613776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:22.621852 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:00:22.629730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:22.630936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:22.635430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:22.635430 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:22.635430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:22.635430 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:22.658338 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:22.658338 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:22.661468 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:22.661468 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:22.675271 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:22.683594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:22.695920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.695920 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.695920 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.695920 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.695920 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:22.696168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.696168 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.696168 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.696168 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.696168 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:22.696720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.063s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:22.696720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:22.697264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('15', '0', '0', 0) found on session 23 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:22.697405 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:22.709125 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:22.709527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.075s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:22.709527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:22.711130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] HCTL ('16', '0', '0', 0) found on session 24 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:22.711130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:22.716815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 23 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:22.717577 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:22.725530 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:22.728663 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Searching for a device in session 24 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:22.728879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:23.135605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:23.135867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:23.136073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:23.136291 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:00:23.634920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:00:23.811912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:24.190038 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:00:24.192614 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.299707 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.300302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.426248 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.430458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.535899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.539421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.661649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.665183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Found WWN 330000000c3ad8151 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:24.667093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.052s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:24.667093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== connect_volume: return (2053ms) {'type': 'block', 'scsi_wwn': '330000000c3ad8151', 'path': '/dev/dm-3', 'multipath_id': '330000000c3ad8151'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:24.669701 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c3ad8151', 'path': '/dev/dm-3', 'multipath_id': '330000000c3ad8151'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:24.674113 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.733909 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.734983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.735277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.736419 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.736681 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.737210 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-a7ef8ccb-c585-4d52-821d-9625a7566f42 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.737417 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.737600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.737786 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.737923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.738365 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.739398 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.739559 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.739713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.739930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.740029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.740147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.740316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-43e8369c-2abf-41ee-8e75-e0471b3094a2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.740448 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.740594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.740840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.741054 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.741054 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.741215 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.744152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.744435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.745439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.745439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.746545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.747215 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.747391 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:24.747559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:24.747724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:24.747906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:24.748154 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:24.748226 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5834c70-a2cb-4824-ba7d-d6eea3dd970f req-09d72a03-f418-472d-8bfa-b698a750cdd1 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:24.780824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.781497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:24.902996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:24.909452 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.016154 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.019232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.152258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.159849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.213567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-197280651',id=15,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:11Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-px15w3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:12Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=66b166c9-35a8-471b-80c3-a1bfdd60b26b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:86:ac:76"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:25.214055 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "vif_mac": "fa:16:3e:86:ac:76"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:25.214857 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:25.217915 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:25.222784 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'pci_devices' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:25.270254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.271670 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.372023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.377089 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:00:25.380716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.481553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.482524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.565774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:25.607840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.611343 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:00:25.614230 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:25.662236 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:25.662736 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12722MB free_disk=74.3983039855957GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:00:25.662881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:25.663318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:25.729224 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:25.731149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <uuid>66b166c9-35a8-471b-80c3-a1bfdd60b26b</uuid>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <name>instance-0000000f</name>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-197280651</nova:name>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:00:21</nova:creationTime>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:user uuid="8d25c63261bb45f1bc8ab1e39768c377">tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member</nova:user>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:project uuid="89f7e0bdf71e47a9b6de4e03f880f492">tempest-ServerBootFromVolumeStableRescueTest-343983155</nova:project>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         <nova:port uuid="af02a518-4683-4fb9-88cb-e597d6024a76">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="serial">66b166c9-35a8-471b-80c3-a1bfdd60b26b</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="uuid">66b166c9-35a8-471b-80c3-a1bfdd60b26b</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <alias name="ua-6704aebd-739b-4cf9-aee6-37b702975722"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <serial>6704aebd-739b-4cf9-aee6-37b702975722</serial>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.rescue"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <boot order="1"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:86:ac:76"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <target dev="tapaf02a518-46"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/console.log" append="off"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:25.731149 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:25.738658 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance destroyed successfully.
May 26 05:00:26.170351 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3b382422-f865-4e5b-94d5-8a3d0b875841 req-997ad9cf-ea07-4d5d-a225-28ad135acba7 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-deleted-43e8369c-2abf-41ee-8e75-e0471b3094a2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:26.170351 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-3b382422-f865-4e5b-94d5-8a3d0b875841 req-997ad9cf-ea07-4d5d-a225-28ad135acba7 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Neutron deleted interface 43e8369c-2abf-41ee-8e75-e0471b3094a2; detaching it from the instance and deleting it from the info cache
May 26 05:00:26.171139 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3b382422-f865-4e5b-94d5-8a3d0b875841 req-997ad9cf-ea07-4d5d-a225-28ad135acba7 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "address": "fa:16:3e:10:61:df", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap30fae245-49", "ovs_interfaceid": "30fae245-4921-4b63-a1d2-9f7b2a02b90e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:26.197885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:26.198149 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:26.598973 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ec937f9-3fbe-42d5-b3ea-c5fc719b1c97 req-c779e1a1-3e93-4bb5-a643-76c01543eb4d service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-deleted-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:26.599119 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-2ec937f9-3fbe-42d5-b3ea-c5fc719b1c97 req-c779e1a1-3e93-4bb5-a643-76c01543eb4d service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Neutron deleted interface 30fae245-4921-4b63-a1d2-9f7b2a02b90e; detaching it from the instance and deleting it from the info cache
May 26 05:00:26.599490 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2ec937f9-3fbe-42d5-b3ea-c5fc719b1c97 req-c779e1a1-3e93-4bb5-a643-76c01543eb4d service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "address": "fa:16:3e:b8:92:2f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2b9c11dd-15", "ovs_interfaceid": "2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:26.675088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:26.685484 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3b382422-f865-4e5b-94d5-8a3d0b875841 req-997ad9cf-ea07-4d5d-a225-28ad135acba7 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Detach interface failed, port_id=43e8369c-2abf-41ee-8e75-e0471b3094a2, reason: Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:26.705229 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'flavor' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:26.742696 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 23a26816-a71d-42c9-8061-d464d5058a92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.742851 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 255cce8a-f08d-4c8e-b498-4b0ef153fc5b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.742915 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.743078 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f40c13f1-a910-4f6a-b000-2baa84ce86fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.743078 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e92b6ba1-ed68-40ff-b800-059778f862ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.743181 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance d8186beb-e5d9-41ee-8a66-17f7921ed75c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.743504 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance ecc66071-7d58-4b53-ad30-1b259d40f744 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.744172 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 66b166c9-35a8-471b-80c3-a1bfdd60b26b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.744172 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:00:26.744172 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:00:26.744172 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2240MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:00:25 up 32 min,  2 users,  load average: 11.19, 5.50, 2.48\n', 'num_instances': '9', 'num_vm_active': '9', 'num_task_None': '7', 'num_os_type_None': '9', 'num_proj_89f7e0bdf71e47a9b6de4e03f880f492': '4', 'io_workload': '1', 'num_proj_278ea77812db4e90a14904f104739285': '2', 'num_proj_f5d660575e954baf8f26c989e3b488de': '1', 'num_task_rescuing': '1', 'num_proj_3d5b058d94fd42eeaf1703daec3f3d46': '1', 'num_task_deleting': '1', 'num_proj_a773253d42414a86a7ee9ed5a1939fdc': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:00:26.877635 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:26.877635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:26.877635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:26.877635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:26.879596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:26.879596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:26.879877 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-deleted-2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:26.880006 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Neutron deleted interface 2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2; detaching it from the instance and deleting it from the info cache
May 26 05:00:26.880352 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "203a11b7-726d-4b89-a085-71ee7033cf4b", "address": "fa:16:3e:8b:ae:47", "network": {"id": "c7c3cd1d-cdc3-49da-946f-79a45cd0935d", "bridge": "br-int", "label": "tempest-device-tagging-net2-1979442154", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap203a11b7-72", "ovs_interfaceid": "203a11b7-726d-4b89-a085-71ee7033cf4b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:27.107192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ec937f9-3fbe-42d5-b3ea-c5fc719b1c97 req-c779e1a1-3e93-4bb5-a643-76c01543eb4d service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Detach interface failed, port_id=30fae245-4921-4b63-a1d2-9f7b2a02b90e, reason: Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:27.263678 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:27.266642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:27.266642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:27.266642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] No VIF found with MAC fa:16:3e:86:ac:76, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:27.269228 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Using config drive
May 26 05:00:27.389400 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Detach interface failed, port_id=2b9c11dd-15d7-457f-9b8b-81f8eaa1c5b2, reason: Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:27.389400 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:27.389400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:27.389611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:27.389658 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:27.389798 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:27.390080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:27.390341 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:27.390565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:27.390753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:27.390889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:27.391028 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:27.391164 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-30fae245-4921-4b63-a1d2-9f7b2a02b90e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:27.391331 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:27.391481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Acquiring lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:27.391620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:27.391758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:27.392249 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] No waiting events found dispatching network-vif-unplugged-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:27.392471 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-unplugged-203a11b7-726d-4b89-a085-71ee7033cf4b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:27.392831 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-deleted-203a11b7-726d-4b89-a085-71ee7033cf4b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:27.392831 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Neutron deleted interface 203a11b7-726d-4b89-a085-71ee7033cf4b; detaching it from the instance and deleting it from the info cache
May 26 05:00:27.393027 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [{"id": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "address": "fa:16:3e:55:64:fe", "network": {"id": "b3ed0483-bfe2-473b-945a-83f2eedaf398", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1597999770-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7ef8ccb-c5", "ovs_interfaceid": "a7ef8ccb-c585-4d52-821d-9625a7566f42", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "address": "fa:16:3e:4c:58:22", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d7b6098-37", "ovs_interfaceid": "3d7b6098-3764-4de0-91cb-6a6ceb63e326", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "address": "fa:16:3e:d7:21:8f", "network": {"id": "0d7992de-672f-4c9e-bc68-0bda4359214b", "bridge": "br-int", "label": "tempest-device-tagging-net1-926838777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.155", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a773253d42414a86a7ee9ed5a1939fdc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap98a60a4c-e6", "ovs_interfaceid": "98a60a4c-e6bd-4e5a-9eaa-20c0b7c1dc69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:27.417772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:27.418040 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:27.716669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.518s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:27.730336 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:27.770255 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'ec2_ids' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:27.899390 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b3879d7-58c2-4edf-a9f6-4357cee4189b req-79ff162f-a56d-44e8-bbe6-3e1f074a0169 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Detach interface failed, port_id=203a11b7-726d-4b89-a085-71ee7033cf4b, reason: Instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:27.920857 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:28.234753 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Took 5.89 seconds to deallocate network for instance.
May 26 05:00:28.274966 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:28.275335 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'keypairs' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:28.300909 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53313fc1-6395-4262-8c77-8c9718216c00 req-8811f722-84d8-428f-9592-d83da00db7c8 service nova] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Received event network-vif-deleted-a7ef8ccb-c585-4d52-821d-9625a7566f42 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:28.428804 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:00:28.429016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.766s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:28.429758 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 55.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:00:28.781969 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:28.786535 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:28.806053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:28.849928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:28.850155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:28.850441 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attaching volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8 to /dev/vdb
May 26 05:00:28.911354 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:28.927410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:00:28.958835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:29.007921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:00:29.008481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:00:29.018805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:00:29.019787 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb', 'fe80::fc16:3eff:feb9:51f5', 'fe80::fc16:3eff:fe37:990', 'fe80::84b:3cff:feeb:b861', 'fe80::fc16:3eff:fe4f:7799', 'fe80::6ca5:f0ff:fe00:e4f2'] 
May 26 05:00:29.019916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:00:29.020045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:00:29.020687 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:29.021213 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating existing volume attachment record: 79040fcb-fa02-42b1-86a0-1bb6083d6235 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:00:29.120490 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Creating config drive at /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config.rescue
May 26 05:00:29.134256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqow8tp09 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:29.191411 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqow8tp09" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:29.598487 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:29.599230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:29.599597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:29.600219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:29.600975 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:29.621314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:29.621314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:29.621314 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:29.621756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:29.623499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:29.623791 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:29.638689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:29.638689 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:29.646370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:29.646370 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:29.655671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8] added
May 26 05:00:29.655671 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:29.655671 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:29.655671 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:29.655671 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:29.655671 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:29.655671 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:29.655981 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:29.656248 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:29.656552 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8] added
May 26 05:00:29.663657 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:29.663657 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0402(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:29.663657 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:29.730340 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:29.766440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:29.867891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:29.985417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:29.987344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:29.999714 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Took 1.76 seconds to detach 3 volumes for instance.
May 26 05:00:30.483289 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:30.483587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:30.483803 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:30.483948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:30.484117 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:30.484292 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-25a94a0c-1199-4c14-9433-e0f7bab17de2 req-9a89e5c9-dafe-456f-afe6-4e42ff0c2f8d service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state rescuing.
May 26 05:00:30.513086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:30.513721 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:30.568257 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:30.586799 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0022464629998921737 future=<Future at 0x7d7aa443f410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:30.586974 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:30.587045 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.055503637000129 future=<Future at 0x7d7ac43dfdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:30.587274 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.0553721610001503 future=<Future at 0x7d7ac43dfdd0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:30.589354 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] Emitting event <LifecycleEvent: 1779771615.5844586, 8d835b9c-8a58-4b53-9235-c49e96173d32 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:30.592343 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] VM Stopped (Lifecycle Event)
May 26 05:00:30.658699 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:30.663999 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:30.678328 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:30.678328 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:30.690097 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:30.690097 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.698245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.708593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.717968 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.717968 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.717968 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.717968 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.717968 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:30.718337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.718337 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.718337 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.718337 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.718337 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:30.727988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.727988 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.727988 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.727988 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.727988 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:30.728426 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.728426 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.728426 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.728426 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.728426 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:30.771512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260]
May 26 05:00:30.771512 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260] successful.
May 26 05:00:30.771512 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.772206 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260]
May 26 05:00:30.772206 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260] successful.
May 26 05:00:30.772206 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.793066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.795290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.814642 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.814935 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:30.815141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:30.815256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:30.816562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('10', '-', '-', 0) found on session 28 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:30.816562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:30.829514 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:30.830027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:30.830027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:30.832782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('9', '-', '-', 0) found on session 27 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:30.832934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:30.845264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 28 and hctl ['10', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:30.845264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:30.860081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 27 and hctl ['9', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:30.862930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:30.960105 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 66b166c9-35a8-471b-80c3-a1bfdd60b26b due to new event <LifecycleEvent: 1779771630.95971, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:00:30.960631 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771630.95971, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:30.960631 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Resumed (Lifecycle Event)
May 26 05:00:30.962579 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6bb57fc6-0431-4ed8-8c45-d753c88a2d78 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:31.094554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] [instance: 8d835b9c-8a58-4b53-9235-c49e96173d32] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:31.165774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:31.190296 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:31.190533 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:31.464267 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:31.475258 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:31.623085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:00:31.679105 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:31.695915 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:31.979586 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771631.9791594, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:31.980068 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Started (Lifecycle Event)
May 26 05:00:32.207044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.693s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:32.250654 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Unrescuing
May 26 05:00:32.251843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:32.251843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquired lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:32.251843 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:00:32.291902 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Deleted allocations for instance 0d47d0b8-fefe-4218-9bd0-08c318e7484a
May 26 05:00:32.482857 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:32.484497 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:32.563743 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:32.564269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:32.564463 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:32.564619 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:32.564774 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:32.564932 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-1407199c-f258-43d6-9b46-809b06414eae req-0be13740-64b0-44b0-8180-1cf25ea5ae92 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state rescued and task_state unrescuing.
May 26 05:00:32.642939 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found WWN 330000000341a91e4 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:32.643328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:32.643561 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000341a91e4', 'path': '/dev/dm-1', 'multipath_id': '330000000341a91e4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:32.643991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000341a91e4', 'path': '/dev/dm-1', 'multipath_id': '330000000341a91e4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:32.646740 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'flavor' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:32.755749 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:32.759330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:32.990227 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 05:00:33.158592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attempting to attach volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:00:33.158592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:   <alias name="ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8"/>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:   <serial>4d9d3374-5b43-40cf-920c-5e6075a9cfe8</serial>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]: </disk>
May 26 05:00:33.158592 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:00:33.304277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f6265ff4-1e96-4810-abfd-8adce130cadf tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Lock "0d47d0b8-fefe-4218-9bd0-08c318e7484a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.987s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:33.335354 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:33.466018 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:33.643587 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004265469999609195 future=<Future at 0x7d7ac43dfdd0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:33.643587 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:33.643587 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.9102805449999778 future=<Future at 0x7d7aec149340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:33.643587 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.9101689139999962 future=<Future at 0x7d7aec149340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:33.728020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:34.039448 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [{"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:34.541030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Releasing lock "refresh_cache-66b166c9-35a8-471b-80c3-a1bfdd60b26b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:34.541683 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'flavor' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:34.554801 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0012665950000609882 future=<Future at 0x7d7aec149340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:34.554956 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:34.555583 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Emitting event <LifecycleEvent: 1779771619.5534375, 0d47d0b8-fefe-4218-9bd0-08c318e7484a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:34.555847 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] VM Stopped (Lifecycle Event)
May 26 05:00:34.856375 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:34.863225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:34.863225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:34.863225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:b9:51:f5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:34.933580 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.062898 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c1e92d89-c686-4d78-a85f-821e15552aa1 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 0d47d0b8-fefe-4218-9bd0-08c318e7484a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:35.083221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.088815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.120730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.301944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:35.302148 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:35.347310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.356767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.463658 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999649411000064 future=<Future at 0x7d7aa44ea480 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:35.464284 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999043905000008 future=<Future at 0x7d7aa44ea480 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:35.464417 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998858576999964 future=<Future at 0x7d7aa44ea480 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:35.468945 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance destroyed successfully.
May 26 05:00:35.469709 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'numa_topology' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:35.569799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:35.809570 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lazy-loading 'flavor' on Instance uuid ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:35.980344 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Object Instance<66b166c9-35a8-471b-80c3-a1bfdd60b26b> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:36.418854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1736fcf6-74a0-423f-9c45-3edaa26b4cf1 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.569s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:36.530942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.552988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.557869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.665594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.680117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.750324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.752804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:36.815398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:37.224042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:37.815579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 66b166c9-35a8-471b-80c3-a1bfdd60b26b due to new event <LifecycleEvent: 1779771637.8141806, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:00:37.815579 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771637.8141806, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:37.816736 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Resumed (Lifecycle Event)
May 26 05:00:37.821390 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3a897156-b2b0-4607-938a-56a042f9e558 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:37.949436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:37.950040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:37.950273 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Attaching volume 20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 to /dev/vdb
May 26 05:00:38.025433 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:38.037926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:00:38.065770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:38.111314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:00:38.111722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:00:38.124817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:00:38.126620 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb', 'fe80::fc16:3eff:feb9:51f5', 'fe80::fc16:3eff:fe37:990', 'fe80::84b:3cff:feeb:b861', 'fe80::fc16:3eff:fe4f:7799', 'fe80::6ca5:f0ff:fe00:e4f2', 'fe80::fc16:3eff:fe86:ac76'] 
May 26 05:00:38.126769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:00:38.126896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:00:38.127422 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:38.127755 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updating existing volume attachment record: 236c5117-3f61-4c9e-8f0e-b93dcba88890 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:00:38.319344 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:38.325167 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:38.713837 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:38.714124 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:38.714322 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:38.715023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:38.715232 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:38.731982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:38.733013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:38.733239 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:38.733974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:38.734493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:38.734669 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:38.748595 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:38.748595 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:38.757429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:38.757429 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8] added
May 26 05:00:38.770989 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:38.770989 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:38.770989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:38.771600 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0379(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:38.771600 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:38.774394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8] added
May 26 05:00:38.774394 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:38.774394 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:38.774394 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:38.774394 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:38.774394 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:38.774394 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:38.774917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:38.774917 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0401(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:38.775112 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:38.830416 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771638.8299494, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:38.833003 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Started (Lifecycle Event)
May 26 05:00:38.912176 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Rebuilding instance
May 26 05:00:39.131644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:39.131644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:39.131644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:39.131644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:39.131644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:39.133881 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Terminating instance
May 26 05:00:39.286383 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:39.339479 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:39.341049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: deleting, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:39.638696 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:39.657124 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:39.661298 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:39.687140 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:39.771874 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:39.775585 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:39.791161 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:39.791161 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:39.800508 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:39.800508 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.815748 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.821490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.834589 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.834991 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:39.845755 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] During sync_power_state the instance has a pending task (deleting). Skip.
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.846269 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.846836 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:39.873369 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.40.100,3260]
May 26 05:00:39.873369 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.40.100,3260] successful.
May 26 05:00:39.873369 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.878442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:39.889104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:39.892914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.901774 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.50.100,3260]
May 26 05:00:39.901774 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.50.100,3260] successful.
May 26 05:00:39.901774 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.916813 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.917469 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:39.918283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:39.918650 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:39.918966 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:39.920417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] HCTL ('11', '-', '-', 0) found on session 29 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:39.920596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.936341 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:39.936809 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:39.937382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:39.937555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:39.938848 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] HCTL ('12', '-', '-', 0) found on session 30 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:39.939562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:39.950652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Searching for a device in session 29 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:39.951102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:39.958114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Searching for a device in session 30 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:39.958301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:39.967995 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:39.968775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:40.004077 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99861585299982 future=<Future at 0x7d7aa44b8890 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:40.005348 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Instance destroyed successfully.
May 26 05:00:40.005991 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid 66b166c9-35a8-471b-80c3-a1bfdd60b26b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:40.274293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.324615 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.326910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.345826 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.472093 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:00:40.501626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.508732 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-197280651',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-197280651',id=15,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:30Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-px15w3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:00:38Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=66b166c9-35a8-471b-80c3-a1bfdd60b26b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:40.509240 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "af02a518-4683-4fb9-88cb-e597d6024a76", "address": "fa:16:3e:86:ac:76", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf02a518-46", "ovs_interfaceid": "af02a518-4683-4fb9-88cb-e597d6024a76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:40.512606 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:40.512606 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:40.512606 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.512606 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf02a518-46, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:40.513875 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.514741 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:40.515634 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.522565 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.523288 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.523484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d98e327-750c-4ce9-b7a8-d89a099fdd5d) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:40.524245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.524914 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:40.530937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.533250 np0000001388 nova-compute[98319]: INFO os_vif [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:ac:76,bridge_name='br-int',has_traffic_filtering=True,id=af02a518-4683-4fb9-88cb-e597d6024a76,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf02a518-46')
May 26 05:00:40.535935 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:40.536067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:40.536221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:40.602390 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:40.602390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:40.602390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:40.602390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:40.602552 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:40.603131 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8aa93073-c269-4077-b1e7-2a42cbca9257 req-93e5f7ad-3221-40c8-95ad-f680c093ef74 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received unexpected event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with vm_state active and task_state rebuilding.
May 26 05:00:40.619061 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.627661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:40.647278 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999674369000104 future=<Future at 0x7d7aa45cab10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:40.649565 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance destroyed successfully.
May 26 05:00:40.720113 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Detaching volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:00:40.736160 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:00:40.758983 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attempting to driver detach volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8 from mountpoint /dev/vdb
May 26 05:00:40.763183 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found disk vdb by alias ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:00:40.763356 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Attempting to detach device vdb from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:00:40.763716 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <alias name="ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8"/>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <serial>4d9d3374-5b43-40cf-920c-5e6075a9cfe8</serial>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]: </disk>
May 26 05:00:40.763716 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:00:40.773092 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully detached device vdb from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the persistent domain config.
May 26 05:00:40.774556 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:40.774740 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:40.774908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:41.000073 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:41.000653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:41.000864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:41.001102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:41.001157 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:41.001378 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-738d64af-aacb-4a6f-8a76-21fcfddedd1c req-e3958f8f-edf6-40aa-9752-de405dd2d835 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:41.027649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:41.027876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:41.030980 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:00:41.031128 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Claim successful on node np0000001388
May 26 05:00:41.681549 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:41.756290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Found WWN 330000000020a5c1d for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:41.756635 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:41.756863 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000020a5c1d', 'path': '/dev/dm-2', 'multipath_id': '330000000020a5c1d'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:41.757019 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000020a5c1d', 'path': '/dev/dm-2', 'multipath_id': '330000000020a5c1d'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:41.757890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.221s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:41.758440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6704aebd-739b-4cf9-aee6-37b702975722', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:41.759218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:41.759976 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lazy-loading 'flavor' on Instance uuid ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:41.788288 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [23] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [24] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:41.788536 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:41.788746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:41.788811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '23')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:41.789980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722', '24')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:41.791808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c16c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:41.792057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Removing multipathed devices sdk, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:41.792355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flush multipath device 330000000c3ad8151 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:41.840811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:41.891595 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:41.946735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:41.946887 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:41.947934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:41.959209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:41.959384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:41.974401 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.017723 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.40.100,3260]
May 26 05:00:42.017723 np0000001388 nova-compute[98319]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.40.100,3260] successful.
May 26 05:00:42.017723 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.036657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.048094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.080533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.50.100,3260]
May 26 05:00:42.080533 np0000001388 nova-compute[98319]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-6704aebd-739b-4cf9-aee6-37b702975722, portal: 192.168.50.100,3260] successful.
May 26 05:00:42.080533 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.086658 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Refreshing inventories for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 26 05:00:42.095183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.095312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:42.095407 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== disconnect_volume: return (1558ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:42.095673 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:42.095986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.321s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:42.096502 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Deleting instance files /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b_del
May 26 05:00:42.096830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:42.096830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:42.097382 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Deletion of /opt/stack/data/nova/instances/66b166c9-35a8-471b-80c3-a1bfdd60b26b_del complete
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:42.124342 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '27')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:42.124342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '28')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:42.125579 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4442020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:42.125842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:42.126182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flush multipath device 330000000341a91e4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:42.147120 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Updating ProviderTree inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 26 05:00:42.147334 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 05:00:42.162355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:42.193192 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Refreshing aggregate associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 26 05:00:42.213428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:42.251869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:42.252016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:42.255682 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Refreshing trait associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, traits: COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 26 05:00:42.258887 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:42.263861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Attempting to attach volume 20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:00:42.264874 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:   <alias name="ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8"/>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:   <serial>20f478b1-9e61-4ea9-9d38-1f0dc1d222d8</serial>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]: </disk>
May 26 05:00:42.264874 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:00:42.271532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:42.271532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:42.282616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.323022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260]
May 26 05:00:42.323022 np0000001388 nova-compute[98319]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260] successful.
May 26 05:00:42.323022 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.338522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.352964 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.385458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260]
May 26 05:00:42.385458 np0000001388 nova-compute[98319]: Logout of [sid: 28, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260] successful.
May 26 05:00:42.385458 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.404858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:42.404858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:42.404858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== disconnect_volume: return (1625ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:42.404858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:42.586684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:42.603804 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Took 2.96 seconds to destroy the instance on the hypervisor.
May 26 05:00:42.604628 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:42.604800 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:42.604909 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:42.605169 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:42.710011 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:42.710590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:42.710780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:42.710907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:42.711037 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:42.711176 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-85bbd8a1-0ae2-419f-9cfc-5859d415075a req-9ab6de61-9d90-46c9-97e0-8f63b277350d service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received unexpected event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with vm_state active and task_state rebuilding.
May 26 05:00:42.754857 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:42.854419 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:42.854419 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:43.097514 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.100069 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:43.100735 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4cde298a-cf89-44b8-8ef5-6132461ec480 req-c49234f3-0afa-4c47-8891-fc4d403eb3f1 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-deleted-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.101102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:43.101359 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-4cde298a-cf89-44b8-8ef5-6132461ec480 req-c49234f3-0afa-4c47-8891-fc4d403eb3f1 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Neutron deleted interface af02a518-4683-4fb9-88cb-e597d6024a76; detaching it from the instance and deleting it from the info cache
May 26 05:00:43.101649 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4cde298a-cf89-44b8-8ef5-6132461ec480 req-c49234f3-0afa-4c47-8891-fc4d403eb3f1 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:43.102611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.102746 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:43.102854 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:43.102970 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.103101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:43.103257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:43.103367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.103536 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:43.103908 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state deleting.
May 26 05:00:43.104051 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.104172 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:43.104330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:43.104494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.104603 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:43.104714 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received unexpected event network-vif-plugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with vm_state active and task_state deleting.
May 26 05:00:43.104809 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.105031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:43.105610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:43.105610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.105610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:43.105610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:43.106263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:43.107435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Acquiring lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:43.107435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:43.107435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.107642 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] No waiting events found dispatching network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:43.108225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-637a9721-a9d9-4a1d-a324-9d3a9aec7b4a req-f0a3bb34-70fc-4687-8249-8bca6c0156fa service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Received event network-vif-unplugged-af02a518-4683-4fb9-88cb-e597d6024a76 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:43.355041 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:43.473002 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance destroyed successfully.
May 26 05:00:43.474022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-ServerActionsTestOtherA-server-1291030240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='7353cfc8-6605-4735-b2e1-84717957e228',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:46Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:43.474278 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:43.474881 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:43.475131 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:43.476120 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:43.476530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped4c3636-85, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:43.478720 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:43.480210 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:43.481774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:43.482472 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d41f36d-ab7b-4c36-948b-3cc2c7b179ce) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:43.482837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:43.483597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:43.484541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:43.488226 np0000001388 nova-compute[98319]: INFO os_vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85')
May 26 05:00:43.489549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:43.489997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:43.490313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:43.490861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:43.491265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:43.491494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:43.517545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:43.517545 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:43.517545 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:43.517545 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:43.517545 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:43.517782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:43.517782 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:43.517782 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:43.517782 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:43.517782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:43.518015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:43.518015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:43.519154 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:00:43.519154 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:43.519336 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:00:43.519604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c3ce0>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:43.519604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:43.519761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:43.519871 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== disconnect_volume: return (30ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:43.519977 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:43.520269 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Deleting instance files /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c_del
May 26 05:00:43.521393 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Deletion of /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c_del complete
May 26 05:00:43.553395 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:43.610480 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4cde298a-cf89-44b8-8ef5-6132461ec480 req-c49234f3-0afa-4c47-8891-fc4d403eb3f1 service nova] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Detach interface failed, port_id=af02a518-4683-4fb9-88cb-e597d6024a76, reason: Instance 66b166c9-35a8-471b-80c3-a1bfdd60b26b could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:43.864582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.836s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:43.865212 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:00:43.927651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:43.927891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:43.928406 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:43.928406 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] No VIF found with MAC fa:16:3e:37:09:90, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:44.055683 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Took 1.45 seconds to deallocate network for instance.
May 26 05:00:44.373078 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:00:44.374538 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:00:44.374860 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:44.375117 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:44.489729 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '08922d29201545f0ba67ae8ac1eb77e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '07c7eafe2c8f4d5bac4c03e3968605a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:00:44.532976 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Booting with volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8 at /dev/vdb
May 26 05:00:44.582846 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:44.596836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:00:44.615458 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Took 0.56 seconds to detach 1 volumes for instance.
May 26 05:00:44.618143 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Deleting volume: 6704aebd-739b-4cf9-aee6-37b702975722 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:00:44.620943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:44.659509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:00:44.660021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:00:44.671022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:00:44.673021 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:feda:fbd7', 'fe80::fc16:3eff:fe9c:4cbb', 'fe80::fc16:3eff:fe37:990', 'fe80::84b:3cff:feeb:b861', 'fe80::fc16:3eff:fe4f:7799', 'fe80::6ca5:f0ff:fe00:e4f2'] 
May 26 05:00:44.673521 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:00:44.673789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:00:44.674056 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:44.674364 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating existing volume attachment record: a0bd6f41-f804-404f-acce-35063257cd3d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:00:44.699732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:44.878015 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:00:45.095803 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Successfully created port: 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:00:45.205005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:45.205005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:45.382925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:00:45.495916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83eea312-507a-4748-9a5f-9a5ed8789220 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.546s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:45.875103 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:45.875364 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:45.904773 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Successfully updated port: 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:00:45.980417 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:45.981614 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing instance network info cache due to event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:00:45.985146 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:45.986098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:45.986098 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:00:46.378556 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:46.394961 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Creating image(s)
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:46.400802 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:46.404207 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:46.409281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:46.422548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:46.492763 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:46.507222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:46.507581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.507998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.509184 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:46.513912 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:46.514299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:46.555350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:46.608041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:46.609963 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:46.680065 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:00:46.684292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:46.686810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk 1073741824" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:46.687407 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.179s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:46.687855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:46.710234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.713330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.788272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:46.789088 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:00:46.789474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:46.828892 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:00:46.829398 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating image(s)
May 26 05:00:46.829975 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.830190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.830825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:46.831312 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "df09e853e490d1b1f78d654305bad9a66de20101" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.831665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "df09e853e490d1b1f78d654305bad9a66de20101" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.881718 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:46.882098 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Cannot resize image /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:00:46.882404 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:00:46.882597 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Ensure instance console log exists: /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:00:46.882828 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:46.882992 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:46.883110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:46.892380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.688s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:46.915155 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:46.991590 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Deleted allocations for instance 66b166c9-35a8-471b-80c3-a1bfdd60b26b
May 26 05:00:47.230359 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Detaching volume 20f478b1-9e61-4ea9-9d38-1f0dc1d222d8
May 26 05:00:47.303063 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Attempting to driver detach volume 20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 from mountpoint /dev/vdb
May 26 05:00:47.312989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Found disk vdb by alias ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:00:47.316338 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Found disk vdb by alias ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:00:47.318652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Attempting to detach device vdb from instance ecc66071-7d58-4b53-ad30-1b259d40f744 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:00:47.321431 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <alias name="ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8"/>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <serial>20f478b1-9e61-4ea9-9d38-1f0dc1d222d8</serial>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]: </disk>
May 26 05:00:47.321431 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:00:47.331669 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Successfully detached device vdb from instance ecc66071-7d58-4b53-ad30-1b259d40f744 from the persistent domain config.
May 26 05:00:47.331669 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] (1/8): Attempting to detach device vdb with device alias ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 from instance ecc66071-7d58-4b53-ad30-1b259d40f744 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:00:47.332093 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <alias name="ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8"/>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <serial>20f478b1-9e61-4ea9-9d38-1f0dc1d222d8</serial>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]: </disk>
May 26 05:00:47.332093 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:00:47.420343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c055f9b-d855-4881-abae-1bddebe82c96 req-90521717-5fb5-42ba-b34a-76a6ff9d6706 service nova] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:47.420761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:47.420761 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:00:47.662016 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:47.667383 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:47.667673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:47.752509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.part --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:47.755117 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] 7353cfc8-6605-4735-b2e1-84717957e228 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:00:47.759583 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:00:47.760061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.part /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:47.901583 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771647.9008071, ecc66071-7d58-4b53-ad30-1b259d40f744 => ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:00:47.903726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 for instance ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:00:47.906352 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Successfully detached device vdb from instance ecc66071-7d58-4b53-ad30-1b259d40f744 from the live domain config.
May 26 05:00:47.907442 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:47.907980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:47.908350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:47.909021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:47.909430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:47.909633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:47.941353 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:47.941353 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:47.941353 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:47.941353 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:47.941353 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:47.941567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsi session list stdout=tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:47.941567 np0000001388 nova-compute[98319]: tcp: [30] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8 (non-flash)
May 26 05:00:47.941567 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:47.941567 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:47.941567 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:47.941777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:47.941937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '29')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:47.943114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8', '30')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:47.943806 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f3ba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:47.943992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:47.944538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Flush multipath device 330000000020a5c1d {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:47.975973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:47.983030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.part /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.converted" returned: 0 in 0.222s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:47.988993 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.016570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a43e2d62-fede-4991-9bcf-97ec333f0628 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "66b166c9-35a8-471b-80c3-a1bfdd60b26b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.886s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:48.025096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:48.033309 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:00:48.066787 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:48.066992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:48.067990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:48.089465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:48.089910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:48.101165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101.converted --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.101794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "df09e853e490d1b1f78d654305bad9a66de20101" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.270s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:48.102418 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:48.104583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.107373 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:48.108435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.153587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.40.100,3260]
May 26 05:00:48.153587 np0000001388 nova-compute[98319]: Logout of [sid: 29, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.40.100,3260] successful.
May 26 05:00:48.153587 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.171170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.189069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.217139 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.217663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "df09e853e490d1b1f78d654305bad9a66de20101" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:48.218177 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "df09e853e490d1b1f78d654305bad9a66de20101" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:48.221287 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:48.225098 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:00:48.225739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.50.100,3260]
May 26 05:00:48.225739 np0000001388 nova-compute[98319]: Logout of [sid: 30, target: iqn.2023-03.storpool.com:os--volume-20f478b1-9e61-4ea9-9d38-1f0dc1d222d8, portal: 192.168.50.100,3260] successful.
May 26 05:00:48.225739 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.227494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.246079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:48.247301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:48.247529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] <== disconnect_volume: return (339ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:48.247790 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:48.287051 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:48.332140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.332579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101,backing_fmt=raw /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.384135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101,backing_fmt=raw /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk 1073741824" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.384867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "df09e853e490d1b1f78d654305bad9a66de20101" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:48.385453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.483246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:48.488565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/df09e853e490d1b1f78d654305bad9a66de20101 --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.489597 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:00:48.489939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:48.509348 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:48.586689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:48.587050 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Cannot resize image /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:00:48.587450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:00:48.587789 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Ensure instance console log exists: /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:00:48.588024 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:48.588281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:48.588451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:48.590465 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start _get_guest_xml network_info=[{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-26T04:55:38Z,direct_url=<?>,disk_format='qcow2',id=7353cfc8-6605-4735-b2e1-84717957e228,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-26T04:55:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'a0bd6f41-f804-404f-acce-35063257cd3d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd8186beb-e5d9-41ee-8a66-17f7921ed75c', 'attached_at': '', 'detached_at': '', 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'serial': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:00:48.593143 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 26 05:00:48.594983 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='7353cfc8-6605-4735-b2e1-84717957e228', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-1291030240', uuid='d8186beb-e5d9-41ee-8a66-17f7921ed75c'), owner=OwnerMeta(userid='e78b48c4b4dc439086e392b4800b4ad7', username='tempest-ServerActionsTestOtherA-846952046-project-member', projectid='278ea77812db4e90a14904f104739285', projectname='tempest-ServerActionsTestOtherA-846952046'), image=ImageMeta(id='7353cfc8-6605-4735-b2e1-84717957e228', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771648.5945628) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:00:48.597944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:00:48.598396 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:00:48.599215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:00:48.599639 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:00:48.600808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:00:48.601173 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-26T04:55:38Z,direct_url=<?>,disk_format='qcow2',id=7353cfc8-6605-4735-b2e1-84717957e228,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-26T04:55:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:00:48.601381 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:00:48.601528 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:00:48.601704 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:00:48.601832 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:00:48.601963 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:00:48.602170 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:00:48.602443 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:00:48.602685 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:00:48.602916 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:00:48.603141 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:00:48.603444 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'vcpu_model' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:48.840136 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lazy-loading 'flavor' on Instance uuid ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:49.014572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:00:49.014882 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance network_info: |[{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:00:49.016529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start _get_guest_xml network_info=[{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:00:49.021350 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:00:49.022967 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-823898949', uuid='e91a9807-3af1-440f-8391-32c1221de940'), owner=OwnerMeta(userid='08922d29201545f0ba67ae8ac1eb77e6', username='tempest-ServerStableDeviceRescueTest-1077407970-project-member', projectid='07c7eafe2c8f4d5bac4c03e3968605a2', projectname='tempest-ServerStableDeviceRescueTest-1077407970'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771649.0223293) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:00:49.024327 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:00:49.025011 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:00:49.027063 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:00:49.027403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:00:49.028377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:00:49.028760 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:00:49.028919 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:00:49.029018 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:00:49.029069 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:00:49.029155 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:00:49.029272 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:00:49.029401 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:00:49.029534 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:00:49.029643 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:00:49.029825 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:00:49.029950 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:00:49.045999 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-823898949',display_name='tempest-ServerStableDeviceRescueTest-server-823898949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverstabledevicerescuetest-server-823898949',id=17,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/FSn7oCJKnrgir3Rk3qBJB6LzlthHaQG+MECR8g/zke6XlHvpe8f/iQIhXCBT1ggZdEvzhejIaU5Vtr2GJY/bHcc8BNXq/EpE4MAfDnvkL+HN1Sgqoah5w1Eh65Hl9w==',key_name='tempest-keypair-303946473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7eafe2c8f4d5bac4c03e3968605a2',ramdisk_id='',reservation_id='r-h3x8rum0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1077407970',owner_user_name='tempest-ServerStableDeviceRescueTest-1077407970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08922d29201545f0ba67ae8ac1eb77e6',uuid=e91a9807-3af1-440f-8391-32c1221de940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:49.046271 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converting VIF {"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:49.048358 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:49.048358 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'pci_devices' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:49.119982 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:49.121244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:49.121373 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:49.121655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:49.121826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:49.138289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:49.140058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:49.140686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:49.140889 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:49.141351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:49.141629 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:49.157321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:49.157321 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:49.166619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:49.166619 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:49.176843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8] added
May 26 05:00:49.176843 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:49.176843 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:49.176843 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:49.176843 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:49.176843 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:49.176843 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:49.178057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:49.178057 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0369(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:49.178057 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:49.187288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8] added
May 26 05:00:49.187288 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:49.187288 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:49.187288 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:49.187288 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:49.187288 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:49.187288 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:49.187607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:49.187647 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.046(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:49.187754 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:49.405186 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.551635 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <uuid>e91a9807-3af1-440f-8391-32c1221de940</uuid>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <name>instance-00000011</name>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-823898949</nova:name>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:00:49</nova:creationTime>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:user uuid="08922d29201545f0ba67ae8ac1eb77e6">tempest-ServerStableDeviceRescueTest-1077407970-project-member</nova:user>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:project uuid="07c7eafe2c8f4d5bac4c03e3968605a2">tempest-ServerStableDeviceRescueTest-1077407970</nova:project>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         <nova:port uuid="99f251d1-253d-4cbe-8b08-c3a4a9ac5f19">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="serial">e91a9807-3af1-440f-8391-32c1221de940</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="uuid">e91a9807-3af1-440f-8391-32c1221de940</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:d2:77:67"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <target dev="tap99f251d1-25"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/console.log" append="off"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:49.551635 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:49.556374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Preparing to wait for external event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:00:49.557228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:49.557439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:49.558215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:49.559264 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-823898949',display_name='tempest-ServerStableDeviceRescueTest-server-823898949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverstabledevicerescuetest-server-823898949',id=17,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/FSn7oCJKnrgir3Rk3qBJB6LzlthHaQG+MECR8g/zke6XlHvpe8f/iQIhXCBT1ggZdEvzhejIaU5Vtr2GJY/bHcc8BNXq/EpE4MAfDnvkL+HN1Sgqoah5w1Eh65Hl9w==',key_name='tempest-keypair-303946473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='07c7eafe2c8f4d5bac4c03e3968605a2',ramdisk_id='',reservation_id='r-h3x8rum0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1077407970',owner_user_name='tempest-ServerStableDeviceRescueTest-1077407970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08922d29201545f0ba67ae8ac1eb77e6',uuid=e91a9807-3af1-440f-8391-32c1221de940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:00:49.559444 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converting VIF {"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:49.560092 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:49.560744 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:00:49.561262 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.561680 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:49.561759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:00:49.562767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.562767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebe52f6b-0422-5a23-bce4-ed1d1c16f9cb', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:49.566805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.568333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:49.570211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.570418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99f251d1-25, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:49.570811 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99f251d1-25, col_values=(('qos', UUID('91382350-12cf-43ac-8655-3abdeccb0f39')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:49.570979 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99f251d1-25, col_values=(('external_ids', {'iface-id': '99f251d1-253d-4cbe-8b08-c3a4a9ac5f19', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:77:67', 'vm-uuid': 'e91a9807-3af1-440f-8391-32c1221de940'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:49.572088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.576810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:49.582474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:49.583799 np0000001388 nova-compute[98319]: INFO os_vif [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25')
May 26 05:00:49.672454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:49.672804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:49.673064 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:49.673413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:49.673413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:49.676266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Terminating instance
May 26 05:00:49.850544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f18406de-b306-49bb-a676-a136d160f263 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:50.178589 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:50.179709 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:50.188331 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:50.197382 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:50.197382 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:00:50.203468 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:00:50.203468 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.208835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.210131 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.213682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.220898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.233752 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.235261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235261 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235261 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:50.235261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235261 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235261 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:50.235653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235653 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235653 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:50.235783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235783 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.235783 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:50.265987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260]
May 26 05:00:50.265987 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260] successful.
May 26 05:00:50.265987 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.280951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.288829 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260]
May 26 05:00:50.288829 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260] successful.
May 26 05:00:50.288829 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.299025 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('9', '-', '-', 0) found on session 31 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:50.299025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:50.310331 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:50.326896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 31 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:50.326896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:50.332033 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.332033 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.332033 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.332033 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.332033 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:50.332252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.332252 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:50.332252 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.332252 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:50.332252 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:50.333089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:50.333089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:00:50.333228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('10', '-', '-', 0) found on session 32 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:00:50.333556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:00:50.356481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 32 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:00:50.356556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:00:50.435362 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:50.436376 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:50.436376 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:50.436376 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:50.436376 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] No waiting events found dispatching network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:50.436376 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1ce22955-eb87-45b6-bd67-035961c2ff8a req-c3f10c33-ca56-4da5-ac15-a81fe33fcec7 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:50.447619 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.461897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.464057 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003851050000776013 future=<Future at 0x7d7aa44ea480 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:50.464057 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:50.464057 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.538495442999874 future=<Future at 0x7d7aa44b8890 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:50.464057 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.538425350999887 future=<Future at 0x7d7aa44b8890 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:50.512052 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.530614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:50.538678 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999686441999984 future=<Future at 0x7d7aa44f1ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:50.541565 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Instance destroyed successfully.
May 26 05:00:50.542113 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid e92b6ba1-ed68-40ff-b800-059778f862ac {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:51.047699 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1227335800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1227335800',id=12,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:33Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-snpbo5mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:44Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=e92b6ba1-ed68-40ff-b800-059778f862ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:51.048342 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "address": "fa:16:3e:9c:4c:bb", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b60cfde-3c", "ovs_interfaceid": "0b60cfde-3c4e-40f1-959a-62e7c65a18e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:51.049093 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:51.049316 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:51.050880 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.051332 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b60cfde-3c, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:51.053506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.054630 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:51.060672 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.061622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.061622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=17c71704-917a-4462-ae37-ef297aa83ac8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:51.063866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.064822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:51.071819 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.074317 np0000001388 nova-compute[98319]: INFO os_vif [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:4c:bb,bridge_name='br-int',has_traffic_filtering=True,id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b60cfde-3c')
May 26 05:00:51.074704 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Deleting instance files /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac_del
May 26 05:00:51.075895 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Deletion of /opt/stack/data/nova/instances/e92b6ba1-ed68-40ff-b800-059778f862ac_del complete
May 26 05:00:51.102075 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:51.102251 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:51.102411 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No VIF found with MAC fa:16:3e:d2:77:67, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:51.102903 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Using config drive
May 26 05:00:51.141317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:00:51.246767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:51.247010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:51.247010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:51.247335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:51.247335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:51.249294 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Terminating instance
May 26 05:00:51.583428 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:00:51.584556 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:51.584978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:51.585087 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:51.585403 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:51.609026 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:51.688156 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.700120 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:51.755408 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:51.784934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.810972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.821152 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Creating config drive at /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config
May 26 05:00:51.830026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp59cuto_s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:51.854763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:51.902419 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp59cuto_s" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] No waiting events found dispatching network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:52.054587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0024247d-7f92-4ef4-93aa-a649e59ddc18 req-4ed58281-843c-4be9-9306-75a33b708fdb service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:52.056080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac589496-0ef9-41bc-8ed2-473fa94167ce req-a2fb79b6-94bf-426d-aa83-1895d9be01e2 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-deleted-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:52.056142 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-ac589496-0ef9-41bc-8ed2-473fa94167ce req-a2fb79b6-94bf-426d-aa83-1895d9be01e2 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Neutron deleted interface 0b60cfde-3c4e-40f1-959a-62e7c65a18e3; detaching it from the instance and deleting it from the info cache
May 26 05:00:52.056332 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ac589496-0ef9-41bc-8ed2-473fa94167ce req-a2fb79b6-94bf-426d-aa83-1895d9be01e2 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:52.167733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found WWN 330000000341a91e4 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:00:52.169076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:52.170174 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000341a91e4', 'path': '/dev/dm-1', 'multipath_id': '330000000341a91e4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:52.170174 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000341a91e4', 'path': '/dev/dm-1', 'multipath_id': '330000000341a91e4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:00:52.273101 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999613315000033 future=<Future at 0x7d7aa4433140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:52.276261 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Instance destroyed successfully.
May 26 05:00:52.277310 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lazy-loading 'resources' on Instance uuid ecc66071-7d58-4b53-ad30-1b259d40f744 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:52.483966 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] Acquiring lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] No waiting events found dispatching network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:52.569099 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-adb1e94d-ea71-475a-a210-50bea66fa61b req-3e42cfe5-74b3-46c5-8b86-69c5017f8923 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Received event network-vif-unplugged-0b60cfde-3c4e-40f1-959a-62e7c65a18e3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:52.570890 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac589496-0ef9-41bc-8ed2-473fa94167ce req-a2fb79b6-94bf-426d-aa83-1895d9be01e2 service nova] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Detach interface failed, port_id=0b60cfde-3c4e-40f1-959a-62e7c65a18e3, reason: Instance e92b6ba1-ed68-40ff-b800-059778f862ac could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:00:52.570890 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.607137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.681345 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-ServerActionsTestOtherA-server-1291030240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='7353cfc8-6605-4735-b2e1-84717957e228',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:46Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:00:52.681618 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:52.682438 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:52.683996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] End _get_guest_xml xml=<domain type="qemu">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <uuid>d8186beb-e5d9-41ee-8a66-17f7921ed75c</uuid>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <name>instance-0000000d</name>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-1291030240</nova:name>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:00:48</nova:creationTime>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:image uuid="7353cfc8-6605-4735-b2e1-84717957e228">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:user uuid="e78b48c4b4dc439086e392b4800b4ad7">tempest-ServerActionsTestOtherA-846952046-project-member</nova:user>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:project uuid="278ea77812db4e90a14904f104739285">tempest-ServerActionsTestOtherA-846952046</nova:project>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="7353cfc8-6605-4735-b2e1-84717957e228"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         <nova:port uuid="ed4c3636-8554-40bd-a26d-2cb5dbd0fd79">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <system>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="serial">d8186beb-e5d9-41ee-8a66-17f7921ed75c</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="uuid">d8186beb-e5d9-41ee-8a66-17f7921ed75c</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </system>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <os>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </os>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <features>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </features>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   <devices>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <alias name="ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <serial>4d9d3374-5b43-40cf-920c-5e6075a9cfe8</serial>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </disk>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b9:51:f5"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <target dev="taped4c3636-85"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </interface>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/console.log" append="off"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </serial>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <video>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </video>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </rng>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:   </devices>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]: </domain>
May 26 05:00:52.683996 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-ServerActionsTestOtherA-server-1291030240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='7353cfc8-6605-4735-b2e1-84717957e228',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:46Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:00:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.686980 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:00:52.692062 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.692748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f46a159-5026-5d92-80b6-47071bd63998', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.694029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.694985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:52.701998 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.707576 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.707810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped4c3636-85, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.708118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped4c3636-85, col_values=(('qos', UUID('4f19baa2-1b9c-46b4-b3ce-0bbc209541fe')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.708328 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped4c3636-85, col_values=(('external_ids', {'iface-id': 'ed4c3636-8554-40bd-a26d-2cb5dbd0fd79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:51:f5', 'vm-uuid': 'd8186beb-e5d9-41ee-8a66-17f7921ed75c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.711886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.715255 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:52.730167 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.732663 np0000001388 nova-compute[98319]: INFO os_vif [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85')
May 26 05:00:52.783299 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1504326759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachscenariooldversion-server-1504326',id=14,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOarlfsbo8DF77ek4aBHiVl88HpslLarEpf3Bg1CoA2ylk84pfwG/8vglrq+32Gca4M279IQoimi5zWKGKeDW7D5dqwaaKR82OGzGW7gM6IDjbRJcEbk3goahuMrzeQX3Q==',key_name='tempest-keypair-1080471052',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:54Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5d660575e954baf8f26c989e3b488de',ramdisk_id='',reservation_id='r-2o5ktrze',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86198cd150d6446aa52f0f2706b3c9ae',uuid=ecc66071-7d58-4b53-ad30-1b259d40f744,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:52.783659 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converting VIF {"id": "1864280c-210d-4b7c-98d4-011d3c95285a", "address": "fa:16:3e:37:09:90", "network": {"id": "8dd828a2-a88d-44ed-adc0-972332651650", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-668919737-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f5d660575e954baf8f26c989e3b488de", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1864280c-21", "ovs_interfaceid": "1864280c-210d-4b7c-98d4-011d3c95285a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:52.784443 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:52.785257 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:52.791650 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.791973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1864280c-21, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.793187 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.794225 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:52.804908 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.807689 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.807890 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22590a57-7bb2-4941-bc14-4a328ffb8a24) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:52.809771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.810339 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:52.831046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:52.835567 np0000001388 nova-compute[98319]: INFO os_vif [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:09:90,bridge_name='br-int',has_traffic_filtering=True,id=1864280c-210d-4b7c-98d4-011d3c95285a,network=Network(8dd828a2-a88d-44ed-adc0-972332651650),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1864280c-21')
May 26 05:00:52.836014 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Deleting instance files /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744_del
May 26 05:00:52.837236 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Deletion of /opt/stack/data/nova/instances/ecc66071-7d58-4b53-ad30-1b259d40f744_del complete
May 26 05:00:52.988084 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Took 1.40 seconds to deallocate network for instance.
May 26 05:00:53.034813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.042937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.047125 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.074737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.081652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.352995 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Took 1.60 seconds to destroy the instance on the hypervisor.
May 26 05:00:53.354746 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:53.355782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:53.355782 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:53.355782 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:53.410693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:53.502190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:53.502190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:53.531109 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:53.663914 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771653.6633453, e91a9807-3af1-440f-8391-32c1221de940 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:53.664806 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Started (Lifecycle Event)
May 26 05:00:54.060238 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:54.060747 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:54.130073 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:54.132049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] Acquiring lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:54.132290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:54.132489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:54.132995 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] No waiting events found dispatching network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:54.133248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-380bdbc2-322f-4922-8192-11a0ad8c5b1f req-ea07d934-32d8-4b8f-b5e6-4978de3d9389 service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-unplugged-1864280c-210d-4b7c-98d4-011d3c95285a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:54.177273 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:54.183400 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771654.1830714, e91a9807-3af1-440f-8391-32c1221de940 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:54.183631 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Paused (Lifecycle Event)
May 26 05:00:54.259890 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:54.260635 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:54.260800 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:00:54.260926 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:b9:51:f5, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:00:54.261432 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Using config drive
May 26 05:00:54.563592 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:54.623279 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:00:54.677174 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:54.677567 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Processing event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:54.681824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:54.684151 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:00:54.685498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:54.685498 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:54.685498 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-22696b39-29a8-43a5-8604-24250e5d3b4b req-2f780aaa-a713-4756-9873-0708b6fc833e service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state building and task_state spawning.
May 26 05:00:54.686874 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:54.689742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:00:54.694516 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771654.6940691, e91a9807-3af1-440f-8391-32c1221de940 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:54.694759 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Resumed (Lifecycle Event)
May 26 05:00:54.696214 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance spawned successfully.
May 26 05:00:54.696749 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:00:54.768186 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'ec2_ids' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:55.002970 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005017060000227502 future=<Future at 0x7d7aa44b8890 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.003337 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.003424 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.643461550999973 future=<Future at 0x7d7aa45cab10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.003511 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.6433564440001192 future=<Future at 0x7d7aa45cab10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.003837 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Emitting event <LifecycleEvent: 1779771640.00235, 66b166c9-35a8-471b-80c3-a1bfdd60b26b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:55.004011 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] VM Stopped (Lifecycle Event)
May 26 05:00:55.072220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.568s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:55.125257 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Took 1.77 seconds to deallocate network for instance.
May 26 05:00:55.136897 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Deleted allocations for instance e92b6ba1-ed68-40ff-b800-059778f862ac
May 26 05:00:55.199263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:55.203427 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:55.206251 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.206428 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.207234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.207234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.210008 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.210008 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:55.285775 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Object Instance<d8186beb-e5d9-41ee-8a66-17f7921ed75c> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:55.286012 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'keypairs' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:55.512641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: 66b166c9-35a8-471b-80c3-a1bfdd60b26b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.004264871000032144 future=<Future at 0x7d7aa45cab10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1779771640.6468205, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Stopped (Lifecycle Event)
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.881293672000083 future=<Future at 0x7d7aa44f1ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.684662 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.881082636000201 future=<Future at 0x7d7aa44f1ee0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:55.707506 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:55.707665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:55.714871 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Took 9.32 seconds to spawn the instance on the hypervisor.
May 26 05:00:55.715103 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:55.716807 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:00:55.750735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:55.793041 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Object Instance<d8186beb-e5d9-41ee-8a66-17f7921ed75c> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:00:55.801225 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 26 05:00:56.009967 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Creating config drive at /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config
May 26 05:00:56.013540 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wnlhee8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:56.072669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp4wnlhee8" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:00:56.151981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9754fc8d-68ef-48ea-9f60-b41d028db82c tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "e92b6ba1-ed68-40ff-b800-059778f862ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.479s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:56.158899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:56.166726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:00:56.167134 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:00:56.207251 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f552b757-b36b-47df-af38-462c30814a9a req-49bc2be4-596f-4e98-93b9-232e1ca02b1f service nova] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Received event network-vif-deleted-1864280c-210d-4b7c-98d4-011d3c95285a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:56.211739 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lazy-loading 'flavor' on Instance uuid 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:56.226544 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Took 15.25 seconds to build instance.
May 26 05:00:56.535969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.564220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.567411 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.670764 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:00:56.676236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.688340 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.729971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-34205083-7cdd-475f-ad75-8db6b759aff7 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.759s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:56.766211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:56.768667 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.037617 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:57.037858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:57.038361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:57.038537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:57.038653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:57.038800 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-75b474a7-42d1-41c7-842f-376c19e261c0 req-a453360f-05f5-438e-ad72-440a22cfbbb9 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received unexpected event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with vm_state active and task_state rebuild_spawning.
May 26 05:00:57.182105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.544s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:57.196318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:57.196564 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:57.196874 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:57.197067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:57.197242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:57.201580 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Terminating instance
May 26 05:00:57.219760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:57.265542 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Deleted allocations for instance ecc66071-7d58-4b53-ad30-1b259d40f744
May 26 05:00:57.524392 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771657.5238447, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:57.524988 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:00:57.525658 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Resumed (Lifecycle Event)
May 26 05:00:57.525813 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:00:57.529072 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance spawned successfully.
May 26 05:00:57.529400 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:00:57.705920 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:00:57.727526 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.733484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.762636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.810347 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.962872 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:57.971992 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.029080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:58.038677 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:58.045888 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.046991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.050691 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.050691 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.050691 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.053486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.053486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:00:58.058262 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.075783 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Instance destroyed successfully.
May 26 05:00:58.076805 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid 255cce8a-f08d-4c8e-b498-4b0ef153fc5b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:00:58.282059 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f2f3c2c-503e-4701-9309-736941da1246 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Lock "ecc66071-7d58-4b53-ad30-1b259d40f744" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:58.314551 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:58.314909 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing instance network info cache due to event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:00:58.315364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:00:58.315555 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:00:58.315756 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:00:58.364345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:58.364646 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:58.364864 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Attaching volume 84f442bb-8709-47fd-8def-9af99f9885cc to /dev/sdc
May 26 05:00:58.424714 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:58.443876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:00:58.472255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:00:58.507954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:00:58.507954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:00:58.520796 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:00:58.521918 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe17:299f', 'fe80::9810:d8ff:fee9:d834', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe4f:7799', 'fe80::6ca5:f0ff:fe00:e4f2', 'fe80::fc16:3eff:fed2:7767', 'fe80::4c87:b6ff:feb1:cd9f', 'fe80::fc16:3eff:feb9:51f5'] 
May 26 05:00:58.522070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:00:58.522161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:00:58.522420 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:58.522750 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating existing volume attachment record: 2b408941-89eb-4434-a82f-872276ed2993 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:00:58.541989 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 26 05:00:58.542447 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771658.5421586, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:00:58.542611 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Started (Lifecycle Event)
May 26 05:00:58.568068 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:58.582543 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1183761892',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1183761892',id=7,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:59:09Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-q4sqwcqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:59:16Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=255cce8a-f08d-4c8e-b498-4b0ef153fc5b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:00:58.582805 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "0afa9729-7742-4ca2-a601-24454af57a3c", "address": "fa:16:3e:da:fb:d7", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afa9729-77", "ovs_interfaceid": "0afa9729-7742-4ca2-a601-24454af57a3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:00:58.583614 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:00:58.583920 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:00:58.592163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.592389 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0afa9729-77, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:58.593759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.597239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:58.597239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.597239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.597239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0ae050d-60f6-42a1-8e29-5813c4972a68) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:00:58.597932 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.598380 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:00:58.600561 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:58.602089 np0000001388 nova-compute[98319]: INFO os_vif [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:fb:d7,bridge_name='br-int',has_traffic_filtering=True,id=0afa9729-7742-4ca2-a601-24454af57a3c,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afa9729-77')
May 26 05:00:58.604157 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:00:58.605560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:58.605560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:58.605560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:58.608250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '77432e15-ce98-4ac5-a98b-72240e46a1b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:00:58.608250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [5] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]: tcp: [6] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3 (non-flash)
May 26 05:00:58.630148 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:00:58.630832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:00:58.630832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '6')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:58.632504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3', '5')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:00:58.633716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac412ade0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:00:58.634003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:00:58.634327 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Flush multipath device 330000000439139f5 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:00:58.670481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:58.717082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:00:58.763783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:00:58.764035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:00:58.767002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:00:58.780368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:00:58.780704 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:00:58.795135 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.821233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:58.828500 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.40.100,3260]
May 26 05:00:58.828500 np0000001388 nova-compute[98319]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.40.100,3260] successful.
May 26 05:00:58.828500 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.844647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.857359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.891390 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.50.100,3260]
May 26 05:00:58.891390 np0000001388 nova-compute[98319]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-77432e15-ce98-4ac5-a98b-72240e46a1b3, portal: 192.168.50.100,3260] successful.
May 26 05:00:58.891390 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.908754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:58.909623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:00:58.909623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] <== disconnect_volume: return (304ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:00:58.909623 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:00:58.909886 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Deleting instance files /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b_del
May 26 05:00:58.910478 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Deletion of /opt/stack/data/nova/instances/255cce8a-f08d-4c8e-b498-4b0ef153fc5b_del complete
May 26 05:00:59.046240 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:00:59.050655 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:00:59.082459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:59.082905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:59.083445 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98319) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 26 05:00:59.101511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:00:59.102086 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:00:59.102391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:59.103560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:59.103804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:00:59.117872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:59.119283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:00:59.119710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:59.120451 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:00:59.120979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:00:59.121375 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:00:59.149836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:59.149836 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:59.149836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:00:59.149836 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:59.164480 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:59.164813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:59.168246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc] added
May 26 05:00:59.168246 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:59.168246 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:59.168246 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:59.168246 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:59.168246 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:59.168246 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:59.168606 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:59.168910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:59.169270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:59.173225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:59.173225 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0483(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:59.173225 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received unexpected event network-vif-plugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with vm_state active and task_state None.
May 26 05:00:59.175980 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:59.176331 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:59.177608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc] added
May 26 05:00:59.177608 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:00:59.177608 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:59.177608 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:59.177608 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:00:59.177608 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:00:59.177608 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:00:59.178048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:00:59.178569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:59.178892 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0581(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:00:59.179136 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:00:59.179355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:59.179555 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:59.179766 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:59.179989 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:59.180167 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:00:59.180401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Acquiring lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:00:59.180585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:00:59.180765 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:00:59.180897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] No waiting events found dispatching network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:00:59.181021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25114d08-2105-4bfd-a354-2d7e3badf639 req-c35558fc-b69d-47dd-8158-8a00a8f76c77 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-unplugged-0afa9729-7742-4ca2-a601-24454af57a3c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:00:59.421404 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Took 1.71 seconds to destroy the instance on the hypervisor.
May 26 05:00:59.422777 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:00:59.423129 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:00:59.423278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:00:59.423500 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:59.553368 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999630835999824 future=<Future at 0x7d7ac4415790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:00:59.585705 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:00:59.872779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:00:59.949270 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:00.095136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7d49441-ff8f-4e45-b993-85c0cc3a6cfd tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.012s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:00.176556 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:01:00.179555 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:01:00.189239 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:01:00.189239 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.195213 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updated VIF entry in instance network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:01:00.195213 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:01:00.201401 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:01:00.201401 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.212261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.218163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.228991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.228991 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.228991 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:00.228991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.228991 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.228991 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:00.237689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.237689 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.237689 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:00.237881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.237881 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.237881 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:00.271161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.50.100,3260]
May 26 05:01:00.271161 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.50.100,3260] successful.
May 26 05:01:00.271161 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.279956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.40.100,3260]
May 26 05:01:00.279956 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.40.100,3260] successful.
May 26 05:01:00.279956 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.288178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.295419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:00.305713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.305713 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.305713 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.305713 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.305713 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:00.305921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.305921 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.305921 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.305921 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.305921 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:00.306324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:00.306491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:01:00.307354 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] HCTL ('7', '-', '-', 0) found on session 33 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:01:00.308758 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:00.317530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:00.318019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.199s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:00.318019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:01:00.319588 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] HCTL ('8', '-', '-', 0) found on session 34 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:01:00.319703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:01:00.330437 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Searching for a device in session 33 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:00.330692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:01:00.348846 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:00.434374 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:00.442171 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e37327ed-482d-443f-a303-e95243944897 req-4cae042b-6d3b-41fd-bbeb-d6b7f14e2743 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Received event network-vif-deleted-0afa9729-7742-4ca2-a601-24454af57a3c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:00.443502 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-e37327ed-482d-443f-a303-e95243944897 req-4cae042b-6d3b-41fd-bbeb-d6b7f14e2743 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Neutron deleted interface 0afa9729-7742-4ca2-a601-24454af57a3c; detaching it from the instance and deleting it from the info cache
May 26 05:01:00.443502 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e37327ed-482d-443f-a303-e95243944897 req-4cae042b-6d3b-41fd-bbeb-d6b7f14e2743 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:00.699437 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-78ab4f8d-b9d6-402f-80c5-84b11352084d req-dafa788d-28ba-4637-b0bf-df2b6a02d0fd service nova] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:00.938789 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Took 1.52 seconds to deallocate network for instance.
May 26 05:01:00.954490 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e37327ed-482d-443f-a303-e95243944897 req-4cae042b-6d3b-41fd-bbeb-d6b7f14e2743 service nova] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Detach interface failed, port_id=0afa9729-7742-4ca2-a601-24454af57a3c, reason: Instance 255cce8a-f08d-4c8e-b498-4b0ef153fc5b could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:01:01.134156 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:01.346371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Searching for a device in session 34 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:01.346371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:01:01.519326 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Took 0.58 seconds to detach 1 volumes for instance.
May 26 05:01:01.524150 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Deleting volume: 77432e15-ce98-4ac5-a98b-72240e46a1b3 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:01:01.690144 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:02.000512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:02.096879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:02.097062 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:02.144647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Found WWN 330000000b53a9d6c for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:01:02.144926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:02.145170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000b53a9d6c', 'path': '/dev/dm-0', 'multipath_id': '330000000b53a9d6c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:02.145341 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b53a9d6c', 'path': '/dev/dm-0', 'multipath_id': '330000000b53a9d6c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:01:02.149379 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lazy-loading 'flavor' on Instance uuid 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:02.516762 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:02.516930 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:02.653570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <alias name="ua-84f442bb-8709-47fd-8def-9af99f9885cc"/>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <serial>84f442bb-8709-47fd-8def-9af99f9885cc</serial>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:   <address type="drive" controller="0" unit="2"/>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:02.653570 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:01:03.020265 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:03.526843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.430s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:03.597341 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Deleted allocations for instance 255cce8a-f08d-4c8e-b498-4b0ef153fc5b
May 26 05:01:03.601350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:03.780699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:03.781192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:04.284179 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:04.384636 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No BDM found with device name sda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:04.387264 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:04.387264 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:04.387264 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] No VIF found with MAC fa:16:3e:4f:77:99, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:01:04.607082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f35296c5-58ee-4e16-beb7-cf9fbaae68d9 tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "255cce8a-f08d-4c8e-b498-4b0ef153fc5b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.410s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:04.862436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:04.863048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:04.866596 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:01:04.866801 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Claim successful on node np0000001388
May 26 05:01:04.892669 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:05.444999 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:05.445127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:05.445313 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "23a26816-a71d-42c9-8061-d464d5058a92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:05.445445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:05.445548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:05.447366 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Terminating instance
May 26 05:01:05.539504 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0011169949998475204 future=<Future at 0x7d7aa44f1ee0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:05.539895 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] Emitting event <LifecycleEvent: 1779771650.5382292, e92b6ba1-ed68-40ff-b800-059778f862ac => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:05.540043 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:05.540266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] VM Stopped (Lifecycle Event)
May 26 05:01:05.542234 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.7314293860001726 future=<Future at 0x7d7aa4433140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:05.542234 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.731306155000084 future=<Future at 0x7d7aa4433140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:05.954234 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:01:05.962612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd70f161-2636-4158-a6f1-47332e99e3e8 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.598s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:05.975226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:05.978236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.002110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.007388 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.032215 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.038864 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.044296 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: e92b6ba1-ed68-40ff-b800-059778f862ac] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:06.257141 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.265913 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.268057 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:06.268428 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:06.290385 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999636527999883 future=<Future at 0x7d7aa437c950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:06.291905 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Instance destroyed successfully.
May 26 05:01:06.295226 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lazy-loading 'resources' on Instance uuid 23a26816-a71d-42c9-8061-d464d5058a92 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:06.434582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:06.434838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:06.692428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.771763 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:06.799127 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:57:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1945830772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverbootfromvolumestablerescuetest-server-1945830772',id=2,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:07Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='89f7e0bdf71e47a9b6de4e03f880f492',ramdisk_id='',reservation_id='r-3p44ecdd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-343983155',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:18Z,user_data=None,user_id='8d25c63261bb45f1bc8ab1e39768c377',uuid=23a26816-a71d-42c9-8061-d464d5058a92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:01:06.799430 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converting VIF {"id": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "address": "fa:16:3e:17:29:9f", "network": {"id": "c10e8137-0ecf-4905-b77b-4c30fcc98571", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2131799764-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "89f7e0bdf71e47a9b6de4e03f880f492", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc81ef482-06", "ovs_interfaceid": "c81ef482-06df-40d2-b7a8-f9579f4420e4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:06.800238 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:06.800547 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:01:06.803363 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.803971 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc81ef482-06, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:06.806800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.806800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:06.806910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.808092 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:06.808292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f24aa2c1-d32d-4ba4-a388-960de6d13435) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:06.809842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:06.811478 np0000001388 nova-compute[98319]: INFO os_vif [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:29:9f,bridge_name='br-int',has_traffic_filtering=True,id=c81ef482-06df-40d2-b7a8-f9579f4420e4,network=Network(c10e8137-0ecf-4905-b77b-4c30fcc98571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc81ef482-06')
May 26 05:01:06.811880 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Deleting instance files /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92_del
May 26 05:01:06.812856 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Deletion of /opt/stack/data/nova/instances/23a26816-a71d-42c9-8061-d464d5058a92_del complete
May 26 05:01:06.937112 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Detaching volume 84f442bb-8709-47fd-8def-9af99f9885cc
May 26 05:01:06.982989 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Attempting to driver detach volume 84f442bb-8709-47fd-8def-9af99f9885cc from mountpoint /dev/sdc
May 26 05:01:06.987416 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Found disk sdc by alias ua-84f442bb-8709-47fd-8def-9af99f9885cc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:01:06.988631 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Found disk sdc by alias ua-84f442bb-8709-47fd-8def-9af99f9885cc {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:01:06.988778 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Attempting to detach device sdc from instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:01:06.989000 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <alias name="ua-84f442bb-8709-47fd-8def-9af99f9885cc"/>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <serial>84f442bb-8709-47fd-8def-9af99f9885cc</serial>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:06.989000 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:01:06.994523 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Successfully detached device sdc from instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 from the persistent domain config.
May 26 05:01:06.994662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] (1/8): Attempting to detach device sdc with device alias ua-84f442bb-8709-47fd-8def-9af99f9885cc from instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:01:06.995044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <alias name="ua-84f442bb-8709-47fd-8def-9af99f9885cc"/>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <target dev="sdc" bus="scsi"/>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <serial>84f442bb-8709-47fd-8def-9af99f9885cc</serial>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:06.995044 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:01:07.165037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771667.1646388, 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 => ua-84f442bb-8709-47fd-8def-9af99f9885cc> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:01:07.166457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-84f442bb-8709-47fd-8def-9af99f9885cc for instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:01:07.168768 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Successfully detached device sdc from instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 from the live domain config.
May 26 05:01:07.169577 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:01:07.169876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:01:07.170048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:01:07.273038 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00035503599997355195 future=<Future at 0x7d7aa4433140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:07.273523 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Emitting event <LifecycleEvent: 1779771652.272487, ecc66071-7d58-4b53-ad30-1b259d40f744 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:07.273668 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:07.273799 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] VM Stopped (Lifecycle Event)
May 26 05:01:07.274725 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.278258384999845 future=<Future at 0x7d7ac4415790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:07.275403 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.277564482999878 future=<Future at 0x7d7ac4415790 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:07.278901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.416s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:07.279162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:01:07.322072 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:01:07.322801 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:01:07.323066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:01:07.323186 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:01:07.323451 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:07.498184 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:07.776680 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: ecc66071-7d58-4b53-ad30-1b259d40f744] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:07.788865 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:01:07.792216 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:01:07.792216 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:07.792216 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:07.906782 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd30540d27d0d41fc830b6956f6853c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '227df7a111264f7a9f41e18bf610b3bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:01:07.915370 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ecab0b6c-66e5-4595-9a3c-2b4ff3909b6d req-8579ea03-d341-4f0f-9766-efa6b09939d1 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Received event network-vif-deleted-c81ef482-06df-40d2-b7a8-f9579f4420e4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:07.915500 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-ecab0b6c-66e5-4595-9a3c-2b4ff3909b6d req-8579ea03-d341-4f0f-9766-efa6b09939d1 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Neutron deleted interface c81ef482-06df-40d2-b7a8-f9579f4420e4; detaching it from the instance and deleting it from the info cache
May 26 05:01:07.915597 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ecab0b6c-66e5-4595-9a3c-2b4ff3909b6d req-8579ea03-d341-4f0f-9766-efa6b09939d1 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:08.289257 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Successfully created port: aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:01:08.290903 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:01:08.352391 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:08.418676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ecab0b6c-66e5-4595-9a3c-2b4ff3909b6d req-8579ea03-d341-4f0f-9766-efa6b09939d1 service nova] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Detach interface failed, port_id=c81ef482-06df-40d2-b7a8-f9579f4420e4, reason: Instance 23a26816-a71d-42c9-8061-d464d5058a92 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:01:08.794814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:01:08.854147 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Took 1.53 seconds to deallocate network for instance.
May 26 05:01:08.861627 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Successfully updated port: aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:01:08.926573 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-changed-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:08.926779 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Refreshing instance network info cache due to event network-changed-aa7d383a-8a0c-4491-8516-f04d8007eb6f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:01:08.927037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] Acquiring lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:08.927123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] Acquired lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:08.927259 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Refreshing network info cache for port aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:01:09.363859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:09.364356 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:09.365184 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:09.430109 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:09.522676 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:01:09.527314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.357s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:01:09.527637 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '84f442bb-8709-47fd-8def-9af99f9885cc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:01:09.527913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8 (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8 (non-flash)
May 26 05:01:09.565518 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: tcp: [35] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8 (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8 (non-flash)
May 26 05:01:09.565865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:09.566011 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', '34'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-96124046-fdde-46a5-8f7f-513820f292d8', '36')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:01:09.566122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', '34')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:01:09.567520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc', '33')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:01:09.568346 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44404a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:01:09.568568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:01:09.568865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Flush multipath device 330000000b53a9d6c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:01:09.613426 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:01:09.659258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:01:09.692467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:09.712678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:01:09.712914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:01:09.715602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:01:09.727792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:01:09.728307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:01:09.741904 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:09.741904 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:09.743209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.778448 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.40.100,3260]
May 26 05:01:09.778448 np0000001388 nova-compute[98319]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.40.100,3260] successful.
May 26 05:01:09.778448 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.799219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.803887 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:01:09.807221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:01:09.807221 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Creating image(s)
May 26 05:01:09.807221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:09.807221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:09.807221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:09.807578 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:09.812973 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:09.814230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.815190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:09.836163 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:09.850039 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.50.100,3260]
May 26 05:01:09.850039 np0000001388 nova-compute[98319]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-84f442bb-8709-47fd-8def-9af99f9885cc, portal: 192.168.50.100,3260] successful.
May 26 05:01:09.850039 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.872329 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:09.872656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:09.872878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] <== disconnect_volume: return (2703ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:09.873307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:01:09.914858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:09.915434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:09.915969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:09.916489 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:09.921938 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:09.922161 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:10.027047 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:10.027552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:10.083826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk 1073741824" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:10.084857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:10.085244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:10.192949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:10.195230 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Checking if we can resize image /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:01:10.195230 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:10.245758 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:10.275784 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:10.275784 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Cannot resize image /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:01:10.275996 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:01:10.276675 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Ensure instance console log exists: /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:01:10.276675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:10.277123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:10.277189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:10.341293 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95da2f7f-37e5-464c-99ed-b9676e6c7679 req-7a767519-950b-4fbc-a6d3-d0b02919f409 service nova] Releasing lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:10.341989 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquired lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:10.342276 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:01:10.447331 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lazy-loading 'flavor' on Instance uuid 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:10.756087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.392s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:10.817023 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Deleted allocations for instance 23a26816-a71d-42c9-8061-d464d5058a92
May 26 05:01:11.458353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2cd5dd67-9ccc-43f5-acde-dd9b791429da tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.023s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:11.478605 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:11.547306 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:01:11.694957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:11.798954 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:11.812019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:11.826441 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5fca75c5-9dde-4350-a3bc-befe9931c05f tempest-ServerBootFromVolumeStableRescueTest-343983155 tempest-ServerBootFromVolumeStableRescueTest-343983155-project-member] Lock "23a26816-a71d-42c9-8061-d464d5058a92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.381s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:11.982070 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Updating instance_info_cache with network_info: [{"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:12.015770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:12.016037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:12.016314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:12.016500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:12.016650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:12.023633 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Terminating instance
May 26 05:01:12.484541 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Releasing lock "refresh_cache-661673fe-01ce-4719-88d8-be0b350b04a0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:12.485212 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance network_info: |[{"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:01:12.487591 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Start _get_guest_xml network_info=[{"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:01:12.494097 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:01:12.495486 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1977152564', uuid='661673fe-01ce-4719-88d8-be0b350b04a0'), owner=OwnerMeta(userid='d30540d27d0d41fc830b6956f6853c2c', username='tempest-VolumesAdminNegativeTest-951149478-project-member', projectid='227df7a111264f7a9f41e18bf610b3bd', projectname='tempest-VolumesAdminNegativeTest-951149478'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771672.4949658) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:01:12.497387 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:01:12.497803 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:01:12.498908 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:01:12.499122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:01:12.500708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:01:12.501082 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:01:12.502409 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:01:12.502409 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:01:12.502409 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:01:12.502541 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:01:12.502652 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:01:12.502875 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:01:12.503013 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:01:12.503843 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:01:12.504034 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:01:12.504235 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:01:12.526776 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977152564',display_name='tempest-VolumesAdminNegativeTest-server-1977152564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesadminnegativetest-server-1977152564',id=18,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='227df7a111264f7a9f41e18bf610b3bd',ramdisk_id='',reservation_id='r-n3zd6vos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-951149478',owner_user_name='tempest-VolumesAdminNegativeTest-951149478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:09Z,user_data=None,user_id='d30540d27d0d41fc830b6956f6853c2c',uuid=661673fe-01ce-4719-88d8-be0b350b04a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:01:12.526937 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converting VIF {"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:12.528049 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:12.529188 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lazy-loading 'pci_devices' on Instance uuid 661673fe-01ce-4719-88d8-be0b350b04a0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:12.531009 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:01:12.559750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.563416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.584629 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.591929 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.624676 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.848177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:12.848533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:12.848635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:12.848863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:12.848946 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] No waiting events found dispatching network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:12.850658 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-52bcbb1c-45db-42ee-abfb-e25004575b61 req-3fee2ab5-dd60-41c4-a1e3-e24a1e85c608 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:12.882572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.895474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:12.913282 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999095711999871 future=<Future at 0x7d7aa44f1eb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:12.917485 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Instance destroyed successfully.
May 26 05:01:12.918309 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lazy-loading 'resources' on Instance uuid 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:13.034547 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <uuid>661673fe-01ce-4719-88d8-be0b350b04a0</uuid>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <name>instance-00000012</name>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1977152564</nova:name>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:01:12</nova:creationTime>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:user uuid="d30540d27d0d41fc830b6956f6853c2c">tempest-VolumesAdminNegativeTest-951149478-project-member</nova:user>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:project uuid="227df7a111264f7a9f41e18bf610b3bd">tempest-VolumesAdminNegativeTest-951149478</nova:project>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         <nova:port uuid="aa7d383a-8a0c-4491-8516-f04d8007eb6f">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <system>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="serial">661673fe-01ce-4719-88d8-be0b350b04a0</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="uuid">661673fe-01ce-4719-88d8-be0b350b04a0</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </system>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <os>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </os>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <features>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </features>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   <devices>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </disk>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.config"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </disk>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:aa:cc:01"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <target dev="tapaa7d383a-8a"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </interface>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/console.log" append="off"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </serial>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <video>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </video>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </rng>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:   </devices>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]: </domain>
May 26 05:01:13.034547 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Preparing to wait for external event network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977152564',display_name='tempest-VolumesAdminNegativeTest-server-1977152564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesadminnegativetest-server-1977152564',id=18,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='227df7a111264f7a9f41e18bf610b3bd',ramdisk_id='',reservation_id='r-n3zd6vos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-951149478',owner_user_name='tempest-VolumesAdminNegativeTest-951149478-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:09Z,user_data=None,user_id='d30540d27d0d41fc830b6956f6853c2c',uuid=661673fe-01ce-4719-88d8-be0b350b04a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:01:13.037529 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converting VIF {"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:13.038178 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:13.038589 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:01:13.038936 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.039144 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.039373 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:01:13.041356 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.041527 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aa919403-b08a-5b1d-b0de-ab0420d2a3c6', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.056532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.057301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:13.062642 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.067672 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.068153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa7d383a-8a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.068431 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa7d383a-8a, col_values=(('qos', UUID('a2518509-01b6-48bb-b52c-95055bd44f66')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.068537 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa7d383a-8a, col_values=(('external_ids', {'iface-id': 'aa7d383a-8a0c-4491-8516-f04d8007eb6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:cc:01', 'vm-uuid': '661673fe-01ce-4719-88d8-be0b350b04a0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.069550 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.071565 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:13.082179 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.083083 np0000001388 nova-compute[98319]: INFO os_vif [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a')
May 26 05:01:13.421170 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:00:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-92465715',display_name='tempest-AttachSCSIVolumeTestJSON-server-92465715',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachscsivolumetestjson-server-92465715',id=16,image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPReL6KKQM8WPVg1ZkI4f4mdOJpnvunDuAv0/vtDKfAExiq0fn3N+TM263xekrUPkKrUMLA0/s4n8AHAii/cHubf2y6tD8FAoFYaH7S+kIFvSxBNU6Dd5H2kHzUaJILiGg==',key_name='tempest-keypair-1363675201',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:16Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d5b058d94fd42eeaf1703daec3f3d46',ramdisk_id='',reservation_id='r-9rtwctdg',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e1841b1f-f5b7-45e7-9250-16607f4d86f7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1972919827',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1972919827-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:00:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2cfd0a85086451e85699b0f631b52ea',uuid=08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:01:13.424528 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converting VIF {"id": "70888df7-6950-48f1-b043-8b1671d5bd88", "address": "fa:16:3e:4f:77:99", "network": {"id": "cbd746df-b181-4616-b2a6-6cf1f555dc6e", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-805920142-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "3d5b058d94fd42eeaf1703daec3f3d46", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap70888df7-69", "ovs_interfaceid": "70888df7-6950-48f1-b043-8b1671d5bd88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:13.425151 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:13.425637 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:01:13.427145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.427415 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap70888df7-69, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.428530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.431102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:13.434138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.436106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.436801 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd87025d-7b61-46be-b659-37ad418ec94f) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:13.437229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.437960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:13.445563 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:13.449833 np0000001388 nova-compute[98319]: INFO os_vif [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:77:99,bridge_name='br-int',has_traffic_filtering=True,id=70888df7-6950-48f1-b043-8b1671d5bd88,network=Network(cbd746df-b181-4616-b2a6-6cf1f555dc6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap70888df7-69')
May 26 05:01:13.450122 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Deleting instance files /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554_del
May 26 05:01:13.451019 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Deletion of /opt/stack/data/nova/instances/08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554_del complete
May 26 05:01:13.960148 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Took 1.43 seconds to destroy the instance on the hypervisor.
May 26 05:01:13.962150 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:01:13.962473 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:01:13.962611 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:01:13.962847 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:14.069070 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:14.555027 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00048045100015770004 future=<Future at 0x7d7ac4415790 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:14.555027 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Emitting event <LifecycleEvent: 1779771659.5528812, 255cce8a-f08d-4c8e-b498-4b0ef153fc5b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:14.555027 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:14.555331 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] VM Stopped (Lifecycle Event)
May 26 05:01:14.558441 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.731937112999958 future=<Future at 0x7d7aa437c950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:14.558441 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.73177103099988 future=<Future at 0x7d7aa437c950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:14.612393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:14.612626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:14.612912 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] No VIF found with MAC fa:16:3e:aa:cc:01, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:01:14.613581 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Using config drive
May 26 05:01:14.717732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:14.955861 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:14.956309 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] Acquiring lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:14.956309 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:14.956591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:14.956591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] No waiting events found dispatching network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:14.956661 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3db700c-5a6d-449b-beac-1ef47146516a req-5dad8484-c7ba-4659-8c48-4fa298b079c0 service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-unplugged-70888df7-6950-48f1-b043-8b1671d5bd88 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:15.058917 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 255cce8a-f08d-4c8e-b498-4b0ef153fc5b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:15.070046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:15.123259 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:15.183065 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2fbae60-d495-4de9-8ad2-ce80f492f6f1 req-74e6b01f-f804-46f3-a302-31ed9e0de22b service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Received event network-vif-deleted-70888df7-6950-48f1-b043-8b1671d5bd88 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:15.183240 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-a2fbae60-d495-4de9-8ad2-ce80f492f6f1 req-74e6b01f-f804-46f3-a302-31ed9e0de22b service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Neutron deleted interface 70888df7-6950-48f1-b043-8b1671d5bd88; detaching it from the instance and deleting it from the info cache
May 26 05:01:15.183751 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a2fbae60-d495-4de9-8ad2-ce80f492f6f1 req-74e6b01f-f804-46f3-a302-31ed9e0de22b service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:15.620779 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Creating config drive at /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.config
May 26 05:01:15.620779 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:15.628043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5q4g4sf {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:15.688676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2fbae60-d495-4de9-8ad2-ce80f492f6f1 req-74e6b01f-f804-46f3-a302-31ed9e0de22b service nova] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Detach interface failed, port_id=70888df7-6950-48f1-b043-8b1671d5bd88, reason: Instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:01:15.696229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5q4g4sf" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:16.127142 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Took 2.16 seconds to deallocate network for instance.
May 26 05:01:16.177713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.202395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.206357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.315960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.580499 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.583905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.587612 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.611263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:16.637063 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:16.637306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:16.694960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:17.019515 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:17.019825 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:17.039544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:17.117576 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771677.1172607, 661673fe-01ce-4719-88d8-be0b350b04a0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:17.117732 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] VM Started (Lifecycle Event)
May 26 05:01:17.524532 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:17.620060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:17.622245 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771677.6219366, 661673fe-01ce-4719-88d8-be0b350b04a0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:17.622361 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] VM Paused (Lifecycle Event)
May 26 05:01:18.032708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.395s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:18.115175 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Deleted allocations for instance 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554
May 26 05:01:18.124715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:18.126457 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:01:18.437282 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:18.595848 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:18.629472 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:01:19.126642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ede5d739-6fee-49a7-94c1-486bb9c15674 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Lock "08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.110s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:19.525591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-196ba8c3-8aa6-42ef-b10d-81de07d0bfb8 req-300d4f24-e10f-4085-8c29-0916a9dcf586 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:19.525867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-196ba8c3-8aa6-42ef-b10d-81de07d0bfb8 req-300d4f24-e10f-4085-8c29-0916a9dcf586 service nova] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:19.526321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-196ba8c3-8aa6-42ef-b10d-81de07d0bfb8 req-300d4f24-e10f-4085-8c29-0916a9dcf586 service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:19.526439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-196ba8c3-8aa6-42ef-b10d-81de07d0bfb8 req-300d4f24-e10f-4085-8c29-0916a9dcf586 service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:19.528421 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-196ba8c3-8aa6-42ef-b10d-81de07d0bfb8 req-300d4f24-e10f-4085-8c29-0916a9dcf586 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Processing event network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:01:19.528421 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:01:19.532738 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771679.5312977, 661673fe-01ce-4719-88d8-be0b350b04a0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:19.532738 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] VM Resumed (Lifecycle Event)
May 26 05:01:19.535765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:01:19.540321 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance spawned successfully.
May 26 05:01:19.540913 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:01:20.038743 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:20.039267 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:01:20.051801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.051956 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.052422 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.052674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.053011 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.053703 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:20.541926 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:01:20.559084 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Took 10.75 seconds to spawn the instance on the hypervisor.
May 26 05:01:20.561538 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:21.079359 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Took 16.29 seconds to build instance.
May 26 05:01:21.227532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:21.290814 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004473599999528233 future=<Future at 0x7d7aa437c950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:21.290814 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:21.290814 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.6210910679999415 future=<Future at 0x7d7aa44f1eb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:21.290814 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.620977645999801 future=<Future at 0x7d7aa44f1eb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:21.291477 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Emitting event <LifecycleEvent: 1779771666.289856, 23a26816-a71d-42c9-8061-d464d5058a92 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:21.291673 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] VM Stopped (Lifecycle Event)
May 26 05:01:21.582617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.802s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] No waiting events found dispatching network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:21.637854 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f41afbf5-03a2-44d7-8932-938cd78fb905 req-b8cd87f5-c1c7-4c50-b1f9-aed77fafe94a service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received unexpected event network-vif-plugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f for instance with vm_state active and task_state None.
May 26 05:01:21.696763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:21.794576 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 23a26816-a71d-42c9-8061-d464d5058a92] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:22.946262 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:23.441504 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.192868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:24.192868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:24.192868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:24.192868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:24.192868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:24.195090 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Terminating instance
May 26 05:01:24.308655 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.308907 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.309130 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.309325 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.309526 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.309697 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.309867 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.310043 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.310144 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:01:24.310438 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.31 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:01:24.358186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:24.358464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:24.617733 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:01:24.697078 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:01:24.717401 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.741868 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.747710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.770132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.775249 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:24.861525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:25.046612 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999656846000107 future=<Future at 0x7d7aa43aa360 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:25.048453 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Instance destroyed successfully.
May 26 05:01:25.049012 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lazy-loading 'resources' on Instance uuid 661673fe-01ce-4719-88d8-be0b350b04a0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:25.122108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:25.122335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:25.122533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:25.122919 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:01:25.437288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:25.437643 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:25.443511 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:01:25.443511 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Claim successful on node np0000001388
May 26 05:01:25.552890 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1977152564',display_name='tempest-VolumesAdminNegativeTest-server-1977152564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesadminnegativetest-server-1977152564',id=18,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:01:20Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='227df7a111264f7a9f41e18bf610b3bd',ramdisk_id='',reservation_id='r-n3zd6vos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-951149478',owner_user_name='tempest-VolumesAdminNegativeTest-951149478-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:01:21Z,user_data=None,user_id='d30540d27d0d41fc830b6956f6853c2c',uuid=661673fe-01ce-4719-88d8-be0b350b04a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:01:25.553190 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converting VIF {"id": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "address": "fa:16:3e:aa:cc:01", "network": {"id": "d92d334a-1e3d-48fa-9e06-d65e491ca878", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-344472779-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "227df7a111264f7a9f41e18bf610b3bd", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa7d383a-8a", "ovs_interfaceid": "aa7d383a-8a0c-4491-8516-f04d8007eb6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:25.554157 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:25.554450 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:01:25.556310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:25.556580 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa7d383a-8a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:25.557838 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:25.561004 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:25.561252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:25.561490 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:25.566051 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:25.568278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:25.569281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:25.569832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] No waiting events found dispatching network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:25.570655 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2518509-01b6-48bb-b52c-95055bd44f66) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:25.571419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:25.572224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:25.572667 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c3fba3d4-503f-4ce9-acf2-80d6e5fb26a2 req-b62424d7-ae22-4581-90d1-1d37b11d1625 service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:25.573874 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:25.576942 np0000001388 nova-compute[98319]: INFO os_vif [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:cc:01,bridge_name='br-int',has_traffic_filtering=True,id=aa7d383a-8a0c-4491-8516-f04d8007eb6f,network=Network(d92d334a-1e3d-48fa-9e06-d65e491ca878),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa7d383a-8a')
May 26 05:01:25.577145 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Deleting instance files /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0_del
May 26 05:01:25.577949 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Deletion of /opt/stack/data/nova/instances/661673fe-01ce-4719-88d8-be0b350b04a0_del complete
May 26 05:01:26.036089 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:26.090590 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Took 1.39 seconds to destroy the instance on the hypervisor.
May 26 05:01:26.093553 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:01:26.093553 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:01:26.093553 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:01:26.093553 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:26.148120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.179864 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:26.248244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.248871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.335290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.337896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:01:26.349467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.484701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.486235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.602489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.605854 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Error from libvirt while getting description of instance-00000012: [Error Code 42] Domain not found: no domain with matching uuid '661673fe-01ce-4719-88d8-be0b350b04a0' (instance-00000012): libvirt.libvirtError: Domain not found: no domain with matching uuid '661673fe-01ce-4719-88d8-be0b350b04a0' (instance-00000012)
May 26 05:01:26.607489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.703126 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:26.710821 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.710821 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.794715 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.801344 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:01:26.802841 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:26.850687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.045s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:26.850687 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13482MB free_disk=74.3995475769043GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:01:26.850687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:26.898887 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:26.899411 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:27.023328 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:27.404596 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:27.527707 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Took 1.43 seconds to deallocate network for instance.
May 26 05:01:27.667218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:27.667348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] Acquiring lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:27.667499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:27.668234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] Lock "661673fe-01ce-4719-88d8-be0b350b04a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:27.668625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] No waiting events found dispatching network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:27.669302 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received unexpected event network-vif-unplugged-aa7d383a-8a0c-4491-8516-f04d8007eb6f for instance with vm_state deleted and task_state None.
May 26 05:01:27.669302 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eae6d2e9-3478-4db5-8bfd-ae95b4d303e3 req-c29c0bf9-86b4-4e5a-a82d-53c5dd9ac55b service nova] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Received event network-vif-deleted-aa7d383a-8a0c-4491-8516-f04d8007eb6f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:27.912424 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00041107500010184594 future=<Future at 0x7d7aa44f1eb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:27.912638 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] Emitting event <LifecycleEvent: 1779771672.9117148, 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:27.912780 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] VM Stopped (Lifecycle Event)
May 26 05:01:27.915754 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:27.916115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.477s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:27.918592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.066s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:27.918592 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.127630874000033 future=<Future at 0x7d7aa43aa360 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:27.918777 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:01:27.920852 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.125313153999969 future=<Future at 0x7d7aa43aa360 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:28.034996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:28.423609 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: 08e0c92a-ccaf-4cb5-8d93-b7dc5b4d5554] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:28.431714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:01:28.435297 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:01:28.435297 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:28.435714 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:28.558154 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f55e5be56ba5425eab028cfc593a866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e6f813ccf14854b9ea9a5a58629736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:01:28.945600 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:01:29.007263 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f40c13f1-a910-4f6a-b000-2baa84ce86fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:01:29.007626 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance d8186beb-e5d9-41ee-8a66-17f7921ed75c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:01:29.007626 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e91a9807-3af1-440f-8391-32c1221de940 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:01:29.007782 np0000001388 nova-compute[98319]: WARNING nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 661673fe-01ce-4719-88d8-be0b350b04a0 is not being actively managed by this compute host but has allocations referencing this compute host: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. Skipping heal of allocation because we do not know what to do.
May 26 05:01:29.008443 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 20ac28c7-02f1-416e-a5f5-aef40de54382 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:01:29.008443 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:01:29.009269 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:01:26 up 33 min,  2 users,  load average: 10.17, 6.24, 2.92\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '4', 'num_os_type_None': '4', 'num_proj_278ea77812db4e90a14904f104739285': '2', 'io_workload': '1', 'num_proj_07c7eafe2c8f4d5bac4c03e3968605a2': '1', 'num_vm_building': '1', 'num_proj_90e6f813ccf14854b9ea9a5a58629736': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:01:29.280781 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Successfully created port: 8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:01:29.419544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:29.419841 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:29.450989 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:01:29.923371 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:29.996050 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Successfully updated port: 8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:01:30.060775 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-changed-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:30.060775 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Refreshing instance network info cache due to event network-changed-8cc85c5c-63c5-42ee-a30c-853960841a3f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:01:30.060775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] Acquiring lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:30.060775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] Acquired lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:30.060775 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Refreshing network info cache for port 8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:01:30.430127 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:01:30.430290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:30.430637 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.396s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:30.430998 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 54.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:01:30.432190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:30.461836 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:01:30.462986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:01:30.463319 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Creating image(s)
May 26 05:01:30.464041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:30.464352 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:30.465335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:30.466222 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:30.470009 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:30.471302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:30.499165 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Deleted allocations for instance 661673fe-01ce-4719-88d8-be0b350b04a0
May 26 05:01:30.503974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:30.559788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:30.560347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:30.560893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:30.561564 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:30.565651 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:30.566257 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:30.571962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:30.572804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:30.657228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:30.657228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:30.681793 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:01:30.709531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk 1073741824" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:30.709956 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:30.711696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:30.808224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:30.811209 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:01:30.811209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:30.923007 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:30.923489 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Cannot resize image /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:01:30.924087 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:01:30.924333 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Ensure instance console log exists: /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:01:30.924673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:30.924955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:30.925222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:30.938601 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:31.443751 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30b5e7e2-84c4-44aa-9f56-db2b8111f551 req-17b53ff8-0e95-4f3c-9a38-b2f10ce22408 service nova] Releasing lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:31.444241 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquired lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:31.444381 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:01:31.516223 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8723376e-e574-4b2b-8a6c-702cab017f6a tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Lock "661673fe-01ce-4719-88d8-be0b350b04a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:31.727083 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:31.730936 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:31.974125 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:32.107372 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:01:33.808891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:34.212678 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:34.251157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:34.353953 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:34.602006 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Updating instance_info_cache with network_info: [{"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:34.804460 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.105710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Releasing lock "refresh_cache-20ac28c7-02f1-416e-a5f5-aef40de54382" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:35.106177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance network_info: |[{"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:01:35.108462 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Start _get_guest_xml network_info=[{"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:01:35.111340 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:01:35.113048 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-821958707', uuid='20ac28c7-02f1-416e-a5f5-aef40de54382'), owner=OwnerMeta(userid='f55e5be56ba5425eab028cfc593a866f', username='tempest-VolumesActionsTest-320780185-project-member', projectid='90e6f813ccf14854b9ea9a5a58629736', projectname='tempest-VolumesActionsTest-320780185'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771695.112555) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:01:35.113999 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:01:35.114457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:01:35.115557 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:01:35.115785 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:01:35.117022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:01:35.117529 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:01:35.117720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:01:35.117850 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:01:35.118048 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:01:35.118181 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:01:35.118348 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:01:35.118571 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:01:35.118720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:01:35.118879 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:01:35.119047 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:01:35.119231 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:01:35.134674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-821958707',display_name='tempest-VolumesActionsTest-instance-821958707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-821958707',id=19,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-kuu05wws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:29Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=20ac28c7-02f1-416e-a5f5-aef40de54382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:01:35.134923 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:35.135777 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:35.136502 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lazy-loading 'pci_devices' on Instance uuid 20ac28c7-02f1-416e-a5f5-aef40de54382 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:35.575884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.639146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] End _get_guest_xml xml=<domain type="qemu">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <uuid>20ac28c7-02f1-416e-a5f5-aef40de54382</uuid>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <name>instance-00000013</name>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-821958707</nova:name>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:01:35</nova:creationTime>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:user uuid="f55e5be56ba5425eab028cfc593a866f">tempest-VolumesActionsTest-320780185-project-member</nova:user>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:project uuid="90e6f813ccf14854b9ea9a5a58629736">tempest-VolumesActionsTest-320780185</nova:project>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         <nova:port uuid="8cc85c5c-63c5-42ee-a30c-853960841a3f">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <system>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="serial">20ac28c7-02f1-416e-a5f5-aef40de54382</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="uuid">20ac28c7-02f1-416e-a5f5-aef40de54382</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </system>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <os>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </os>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <features>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </features>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   <devices>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </disk>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.config"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </disk>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ea:5a:26"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <target dev="tap8cc85c5c-63"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </interface>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/console.log" append="off"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </serial>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <video>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </video>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </rng>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:   </devices>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]: </domain>
May 26 05:01:35.639146 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Preparing to wait for external event network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-821958707',display_name='tempest-VolumesActionsTest-instance-821958707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-821958707',id=19,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-kuu05wws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:29Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=20ac28c7-02f1-416e-a5f5-aef40de54382,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:35.641914 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:01:35.642891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.642891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b53fb828-8062-5b46-9b74-8c049aa5ef43', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:35.645689 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.646457 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:35.646739 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.649029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.649158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8cc85c5c-63, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:35.649498 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8cc85c5c-63, col_values=(('qos', UUID('e21fdc15-268c-479b-9010-320d58426f35')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:35.649668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8cc85c5c-63, col_values=(('external_ids', {'iface-id': '8cc85c5c-63c5-42ee-a30c-853960841a3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:5a:26', 'vm-uuid': '20ac28c7-02f1-416e-a5f5-aef40de54382'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:35.650545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.651905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:35.658599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:35.659579 np0000001388 nova-compute[98319]: INFO os_vif [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63')
May 26 05:01:35.835122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:36.344090 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] instance snapshotting
May 26 05:01:36.454758 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Beginning live snapshot process
May 26 05:01:36.733167 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:36.962789 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:36.991846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:36.992088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:37.182808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:37.183043 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:37.183212 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No VIF found with MAC fa:16:3e:ea:5a:26, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:01:37.183689 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Using config drive
May 26 05:01:37.494767 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Detaching volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8
May 26 05:01:37.532509 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Attempting to driver detach volume 4d9d3374-5b43-40cf-920c-5e6075a9cfe8 from mountpoint /dev/vdb
May 26 05:01:37.536980 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found disk vdb by alias ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:01:37.538395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found disk vdb by alias ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:01:37.538395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Attempting to detach device vdb from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:01:37.538395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <alias name="ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8"/>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <serial>4d9d3374-5b43-40cf-920c-5e6075a9cfe8</serial>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:37.538395 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:01:37.548488 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully detached device vdb from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the persistent domain config.
May 26 05:01:37.548488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] (1/8): Attempting to detach device vdb with device alias ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:01:37.548488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <alias name="ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8"/>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <serial>4d9d3374-5b43-40cf-920c-5e6075a9cfe8</serial>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:37.548488 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:01:37.692852 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:37.861800 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Creating config drive at /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.config
May 26 05:01:37.866033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf871nqvq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:37.914598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpf871nqvq" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:37.983938 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:38.080735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:38.096678 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json -f qcow2" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:38.097278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:38.185906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:38.186753 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:38.192598 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:01:38.193243 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:38.269885 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 for instance d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:01:38.270612 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771698.2699065, d8186beb-e5d9-41ee-8a66-17f7921ed75c => ua-4d9d3374-5b43-40cf-920c-5e6075a9cfe8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:01:38.273617 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully detached device vdb from instance d8186beb-e5d9-41ee-8a66-17f7921ed75c from the live domain config.
May 26 05:01:38.280381 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:01:38.281254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:01:38.281254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:01:38.281826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:38.282793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:38.342597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7.delta 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:38.343190 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Quiescing instance not available: QEMU guest agent is not enabled.
May 26 05:01:38.624738 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] COPY block job progress, current cursor: 0 final cursor: 76677120 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 05:01:38.735593 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:38.745931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.459s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:01:38.745931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:01:38.745931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:01:38.759166 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:38.778740 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:38.778740 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:38.778740 np0000001388 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a51a795a-9b79-40d0-91f6-5a16648e04bc (non-flash)
May 26 05:01:38.778740 np0000001388 nova-compute[98319]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:38.778740 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:38.779142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [31] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:38.779142 np0000001388 nova-compute[98319]: tcp: [32] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8 (non-flash)
May 26 05:01:38.779142 np0000001388 nova-compute[98319]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a51a795a-9b79-40d0-91f6-5a16648e04bc (non-flash)
May 26 05:01:38.779142 np0000001388 nova-compute[98319]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:38.779142 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:38.779305 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '32'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a51a795a-9b79-40d0-91f6-5a16648e04bc', '37'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e', '38')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:01:38.779382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '31')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:01:38.781227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8', '32')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:01:38.781954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46dac00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:01:38.781954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:01:38.782277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flush multipath device 330000000341a91e4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:01:38.810284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:01:38.848754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:01:38.864775 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:38.910550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:01:38.910864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:01:38.912045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:01:38.927297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:01:38.927936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:01:38.944519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:38.975324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260]
May 26 05:01:38.975324 np0000001388 nova-compute[98319]: Logout of [sid: 31, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.40.100,3260] successful.
May 26 05:01:38.975324 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:38.995171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:39.008186 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:39.043158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260]
May 26 05:01:39.043158 np0000001388 nova-compute[98319]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-4d9d3374-5b43-40cf-920c-5e6075a9cfe8, portal: 192.168.50.100,3260] successful.
May 26 05:01:39.043158 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:39.064147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:39.064299 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:39.064443 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== disconnect_volume: return (783ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:39.064589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:01:39.136307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] COPY block job progress, current cursor: 76677120 final cursor: 76677120 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 05:01:39.145220 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Skipping quiescing instance: QEMU guest agent is not enabled.
May 26 05:01:39.171915 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:39.178804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:39.203837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:39.219222 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:01:39.219222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7.delta /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:39.531959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7.delta /opt/stack/data/nova/instances/snapshots/tmpzfmg4_sq/bec6bb18c20f44fa85dac3a5317ed8a7" returned: 0 in 0.315s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:01:39.536926 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Snapshot extracted, beginning image upload
May 26 05:01:39.651650 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'flavor' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:39.801004 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:39.830314 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771699.829865, 20ac28c7-02f1-416e-a5f5-aef40de54382 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:39.830448 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] VM Started (Lifecycle Event)
May 26 05:01:39.872006 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:40.048487 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.002278232999969987 future=<Future at 0x7d7aa43aa360 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:40.049777 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:40.050107 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] Emitting event <LifecycleEvent: 1779771685.0460708, 661673fe-01ce-4719-88d8-be0b350b04a0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:40.051419 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] VM Stopped (Lifecycle Event)
May 26 05:01:40.337148 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:40.343296 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771700.3428636, 20ac28c7-02f1-416e-a5f5-aef40de54382 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:40.343529 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] VM Paused (Lifecycle Event)
May 26 05:01:40.556173 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a88ce18-5897-404c-be11-1d6266ef2f72 tempest-AttachSCSIVolumeTestJSON-1972919827 tempest-AttachSCSIVolumeTestJSON-1972919827-project-member] [instance: 661673fe-01ce-4719-88d8-be0b350b04a0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:40.651428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:40.666304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-078d8b8f-4346-4059-a73a-2f79f87e6921 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.673s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:40.848445 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:40.853925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:01:40.939905 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-737539c9-1a4a-4342-8e39-6a8704b87912 req-5bc48eac-4e8d-4806-a281-7180cfead275 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:40.940517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-737539c9-1a4a-4342-8e39-6a8704b87912 req-5bc48eac-4e8d-4806-a281-7180cfead275 service nova] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:40.940804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-737539c9-1a4a-4342-8e39-6a8704b87912 req-5bc48eac-4e8d-4806-a281-7180cfead275 service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:40.941114 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-737539c9-1a4a-4342-8e39-6a8704b87912 req-5bc48eac-4e8d-4806-a281-7180cfead275 service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:40.941337 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-737539c9-1a4a-4342-8e39-6a8704b87912 req-5bc48eac-4e8d-4806-a281-7180cfead275 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Processing event network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:01:40.942593 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:01:40.950668 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:01:40.960897 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance spawned successfully.
May 26 05:01:40.961678 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:01:41.357414 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:01:41.357632 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771701.3574352, 20ac28c7-02f1-416e-a5f5-aef40de54382 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:41.357828 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] VM Resumed (Lifecycle Event)
May 26 05:01:41.388863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:41.389147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:41.389504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:41.389710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:41.389923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:41.394133 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Terminating instance
May 26 05:01:41.470066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.471003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.471460 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.471775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.472151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.472503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:01:41.734877 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:41.864232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:41.866406 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:01:41.878039 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:01:41.904386 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:01:41.931623 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:41.953264 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:41.980037 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Took 11.52 seconds to spawn the instance on the hypervisor.
May 26 05:01:41.980602 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:42.135961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.142727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.178068 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:42.178244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:42.178617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:42.178617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:42.178805 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:42.178943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6603398f-b40c-4496-9147-d7f7b88680f2 req-60032944-36dc-4dc8-813c-ab0b04c2168f service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:42.227986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.241639 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.259438 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Instance destroyed successfully.
May 26 05:01:42.260044 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'resources' on Instance uuid d8186beb-e5d9-41ee-8a66-17f7921ed75c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:42.369462 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:01:42.369880 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999755689999802 future=<Future at 0x7d7aa4487e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:42.372181 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.9975680619998 future=<Future at 0x7d7aa4487e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:42.372747 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.996886085999904 future=<Future at 0x7d7aa4487e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:42.495826 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Took 17.13 seconds to build instance.
May 26 05:01:42.763671 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T04:59:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-215111684',display_name='tempest-ServerActionsTestOtherA-server-1291030240',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-tempest-common-compute-instance-215111684',id=13,image_ref='7353cfc8-6605-4735-b2e1-84717957e228',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBkSeyfZj9gLx2lQ3g/epkLozFgBoGIBZWLXhhfDwhi5ri+WesPVEJnSP4kF9n7YxSB/ru5Arf9tb9xYHXEYyAt27EyyovRjCAJ7V0DGtQgcyx3K6UJ+iatsWmbBBzI+Iw==',key_name='tempest-keypair-1740641526',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:58Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-u05zzesk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=d8186beb-e5d9-41ee-8a66-17f7921ed75c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:01:42.764590 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "address": "fa:16:3e:b9:51:f5", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "taped4c3636-85", "ovs_interfaceid": "ed4c3636-8554-40bd-a26d-2cb5dbd0fd79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:42.764897 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:42.765122 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:01:42.766579 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.767044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped4c3636-85, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:42.771238 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:42.773051 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:42.773331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f19baa2-1b9c-46b4-b3ce-0bbc209541fe) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:42.775991 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:42.778694 np0000001388 nova-compute[98319]: INFO os_vif [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:51:f5,bridge_name='br-int',has_traffic_filtering=True,id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped4c3636-85')
May 26 05:01:42.778694 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Deleting instance files /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c_del
May 26 05:01:42.779683 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Deletion of /opt/stack/data/nova/instances/d8186beb-e5d9-41ee-8a66-17f7921ed75c_del complete
May 26 05:01:42.927258 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Snapshot image upload complete
May 26 05:01:42.927453 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-360ed88c-ec2d-4925-b0da-b6e47a47d064 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Took 6.58 seconds to snapshot the instance on the hypervisor.
May 26 05:01:42.998454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-db19dda4-d947-4998-85f9-e6fadb0ad8b3 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.640s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:43.001699 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:43.003301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:43.003558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:43.003694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:43.003737 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] No waiting events found dispatching network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:43.003907 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-41ff28f3-de06-4658-8c44-0291487adcca req-a3ba6c4f-acd8-4269-a39a-6ffee4a808f2 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received unexpected event network-vif-plugged-8cc85c5c-63c5-42ee-a30c-853960841a3f for instance with vm_state active and task_state None.
May 26 05:01:43.285192 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Took 1.38 seconds to destroy the instance on the hypervisor.
May 26 05:01:43.286589 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:01:43.286589 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:01:43.286589 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:01:43.286589 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:43.362025 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:44.267494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:44.268039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] Acquiring lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] No waiting events found dispatching network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-unplugged-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Received event network-vif-deleted-ed4c3636-8554-40bd-a26d-2cb5dbd0fd79 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Neutron deleted interface ed4c3636-8554-40bd-a26d-2cb5dbd0fd79; detaching it from the instance and deleting it from the info cache
May 26 05:01:44.275162 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:44.407773 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:44.775312 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'flavor' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:44.778147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a29bff9-b2e0-4451-9ee3-3ec4b8e613f1 req-35dc5706-b3eb-4e6a-ad77-3820084087e5 service nova] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Detach interface failed, port_id=ed4c3636-8554-40bd-a26d-2cb5dbd0fd79, reason: Instance d8186beb-e5d9-41ee-8a66-17f7921ed75c could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:01:44.910600 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Took 1.62 seconds to deallocate network for instance.
May 26 05:01:45.417328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:45.417328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:45.502426 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:45.502655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:45.502853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:45.502993 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:45.503098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:45.508173 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Terminating instance
May 26 05:01:45.774509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:45.774839 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:45.782608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:46.013278 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:01:46.037257 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.048245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.069087 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.098530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.102516 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.275270 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.280413 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] No waiting events found dispatching network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:46.335206 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f096c253-03d3-4c0e-9940-f028c6df980b req-925819ef-87b4-4f1c-9054-5411010344ea service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:46.359590 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.368706 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.391289 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999616843999775 future=<Future at 0x7d7aa44bb980 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:46.396837 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Instance destroyed successfully.
May 26 05:01:46.398654 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lazy-loading 'resources' on Instance uuid 20ac28c7-02f1-416e-a5f5-aef40de54382 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:46.736539 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.799511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.382s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:46.861356 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Deleted allocations for instance d8186beb-e5d9-41ee-8a66-17f7921ed75c
May 26 05:01:46.901664 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-821958707',display_name='tempest-VolumesActionsTest-instance-821958707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-821958707',id=19,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:01:41Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-kuu05wws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:01:42Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=20ac28c7-02f1-416e-a5f5-aef40de54382,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:01:46.901956 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "address": "fa:16:3e:ea:5a:26", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8cc85c5c-63", "ovs_interfaceid": "8cc85c5c-63c5-42ee-a30c-853960841a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:01:46.902441 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:01:46.903007 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:01:46.903730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.903937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8cc85c5c-63, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:46.918522 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.919681 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:46.921464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.921601 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e21fdc15-268c-479b-9010-320d58426f35) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:01:46.923792 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:46.924446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:01:46.926489 np0000001388 nova-compute[98319]: INFO os_vif [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:5a:26,bridge_name='br-int',has_traffic_filtering=True,id=8cc85c5c-63c5-42ee-a30c-853960841a3f,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8cc85c5c-63')
May 26 05:01:46.926828 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Deleting instance files /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382_del
May 26 05:01:46.927639 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Deletion of /opt/stack/data/nova/instances/20ac28c7-02f1-416e-a5f5-aef40de54382_del complete
May 26 05:01:46.951298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:46.951539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:46.951805 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attaching volume 679d5805-0f4b-4723-a37c-a22d58f43594 to /dev/vdb
May 26 05:01:47.000797 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:01:47.012854 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:01:47.036922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:47.084265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:01:47.085007 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fed2:7767', 'fe80::4c87:b6ff:feb1:cd9f'] 
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:47.103258 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating existing volume attachment record: f8c998cf-2ce4-45d8-ba17-5c800685769d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:01:47.436396 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Took 1.42 seconds to destroy the instance on the hypervisor.
May 26 05:01:47.437314 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:01:47.437635 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:01:47.438010 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:01:47.438321 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:47.669363 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:01:47.669775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:01:47.669884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:01:47.671035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:01:47.672294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:01:47.687362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:01:47.688115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:01:47.688840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:01:47.689068 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:01:47.689557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:01:47.689836 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:01:47.703003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:01:47.703003 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:47.708150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:01:47.708150 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:47.717094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594] added
May 26 05:01:47.717094 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:01:47.717094 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:01:47.717094 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:01:47.717094 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:01:47.717094 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:01:47.717094 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:47.717508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:01:47.717583 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:01:47.717817 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:01:47.722039 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594] added
May 26 05:01:47.722039 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:01:47.722039 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:01:47.722039 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:01:47.722039 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:01:47.722039 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:01:47.722039 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:47.722349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:01:47.722349 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:01:47.722533 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:01:47.874136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63072a0d-587b-4bbb-b11f-eaf95b2edd5e tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "d8186beb-e5d9-41ee-8a66-17f7921ed75c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.485s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:47.993706 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:48.452071 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:48.452373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] Acquiring lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:48.452602 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:48.452787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:48.453169 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] No waiting events found dispatching network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:48.453676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9e657a27-45ae-40ce-8fa5-a3bd8c3e1077 req-57ca6bd6-7261-4800-addc-177fa47eb42f service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-unplugged-8cc85c5c-63c5-42ee-a30c-853960841a3f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:01:48.718475 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:01:48.723820 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:01:48.731883 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:01:48.731883 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:01:48.736932 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:01:48.736932 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.750410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.755184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.761712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.761712 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.761712 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:48.761923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.761923 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.761923 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:48.770909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.770909 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.770909 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:48.771179 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.771179 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.771179 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:48.797827 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.40.100,3260]
May 26 05:01:48.797827 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.40.100,3260] successful.
May 26 05:01:48.797827 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.808292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.50.100,3260]
May 26 05:01:48.808292 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.50.100,3260] successful.
May 26 05:01:48.808292 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.816698 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.827809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:01:48.836100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.836100 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.836100 np0000001388 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.836100 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.836100 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:48.836316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.836316 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.836316 np0000001388 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.836316 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.836316 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:48.836453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:48.836559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:01:48.837287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] HCTL ('9', '-', '-', 0) found on session 40 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:01:48.837417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:01:48.844750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.844750 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.844750 np0000001388 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.844750 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.844750 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:01:48.844918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:01:48.844918 np0000001388 nova-compute[98319]: tcp: [39] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:01:48.844918 np0000001388 nova-compute[98319]: tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.844918 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:01:48.844918 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:01:48.845231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:48.845491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:01:48.846072 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] HCTL ('10', '-', '-', 0) found on session 41 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:01:48.846237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:01:48.856922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching for a device in session 40 and hctl ['9', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:48.878373 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching for a device in session 41 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:48.878373 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:01:49.136296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:49.597985 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:49.857792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching for a device in session 40 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:01:49.858760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:01:50.102104 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Took 2.66 seconds to deallocate network for instance.
May 26 05:01:50.556959 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d74bf0bc-7917-4f1f-8d93-18970b647f41 req-0addb85f-e502-4031-a332-5e9ca92e26f9 service nova] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Received event network-vif-deleted-8cc85c5c-63c5-42ee-a30c-853960841a3f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:50.575613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:50.607607 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:50.607906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:50.714389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Found WWN 33000000050e736e4 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:01:50.714389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:01:50.714389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '33000000050e736e4', 'path': '/dev/dm-0', 'multipath_id': '33000000050e736e4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:50.714389 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000050e736e4', 'path': '/dev/dm-0', 'multipath_id': '33000000050e736e4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:01:50.720793 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'flavor' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:50.902159 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:50.902856 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:51.227989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attempting to attach volume 679d5805-0f4b-4723-a37c-a22d58f43594 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:01:51.229914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:   <alias name="ua-679d5805-0f4b-4723-a37c-a22d58f43594"/>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:   <serial>679d5805-0f4b-4723-a37c-a22d58f43594</serial>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]: </disk>
May 26 05:01:51.229914 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:01:51.406941 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:51.739280 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:51.917537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.310s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:51.925227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:52.001111 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Deleted allocations for instance 20ac28c7-02f1-416e-a5f5-aef40de54382
May 26 05:01:52.929057 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:52.932627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:52.932627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:52.932627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:01:52.932627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No VIF found with MAC fa:16:3e:d2:77:67, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:01:53.009855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9edf21a2-10e4-4322-88b2-a0c9d19e66e4 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "20ac28c7-02f1-416e-a5f5-aef40de54382" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.507s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:53.049787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:53.050015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:53.552441 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:54.016246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:54.127605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:54.127822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:54.136302 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:01:54.136533 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Claim successful on node np0000001388
May 26 05:01:54.508723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3e8a520a-1ac9-44c8-951e-40515705d08f tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.557s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:55.092308 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Rescuing
May 26 05:01:55.092753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:55.092753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:55.092866 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:01:55.281937 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:55.282183 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:55.379076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:55.379561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:55.527265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:55.527265 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:55.595638 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:55.788876 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:55.882362 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:55.961144 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:56.032898 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:56.160183 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:56.370779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:56.442552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:56.542276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.414s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:56.543162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:56.543356 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:01:56.549462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:01:56.549741 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Claim successful on node np0000001388
May 26 05:01:56.643668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:56.643898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:56.662363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:56.740374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:56.924052 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:57.057919 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:01:57.058231 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:01:57.058915 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:57.058915 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:57.088222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:57.147439 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e78b48c4b4dc439086e392b4800b4ad7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '278ea77812db4e90a14904f104739285', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:01:57.149129 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:01:57.370100 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004502189999584516 future=<Future at 0x7d7aa4487e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:57.370514 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:57.370514 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.020461656999942 future=<Future at 0x7d7aa44bb980 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:57.370514 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.0203775519999 future=<Future at 0x7d7aa44bb980 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:57.371642 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] Emitting event <LifecycleEvent: 1779771702.3695176, d8186beb-e5d9-41ee-8a66-17f7921ed75c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:01:57.371970 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] VM Stopped (Lifecycle Event)
May 26 05:01:57.567828 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:01:57.710443 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Successfully created port: 0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:01:57.714286 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:57.874719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e66f745-38cc-40ed-b49e-fb7086ea3728 None None] [instance: d8186beb-e5d9-41ee-8a66-17f7921ed75c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:01:57.938721 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:01:57.939027 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:01:58.077703 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:01:58.276506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.303225 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.306429 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.331539 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Successfully updated port: 0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:01:58.333069 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.336763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.422388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-changed-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:58.422783 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Refreshing instance network info cache due to event network-changed-0f10a0b5-86a5-4382-99e5-e170ea108458. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:01:58.423033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:58.423235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:58.423609 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Refreshing network info cache for port 0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:01:58.441979 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:01:58.570006 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.579022 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:01:58.582420 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:01:58.583144 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:58.583279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:58.583428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:58.584481 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:01:58.584811 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a6e87c88-315b-431b-b07a-fdfdab4cbdd7 req-49b001f9-8642-4020-9023-d86903b670a9 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state active and task_state rescuing.
May 26 05:01:58.586375 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Booting with volume 5af35d79-38f2-4c5a-bfc7-61d05f88f05f at /dev/vda
May 26 05:01:58.605967 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999134055000013 future=<Future at 0x7d7aa422bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:01:58.610904 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance destroyed successfully.
May 26 05:01:58.611309 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'numa_topology' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:58.652626 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:01:58.662708 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:01:58.683111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:01:58.716904 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:01:58.717224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:01:58.727254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:01:58.728119 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 05:01:58.728268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:01:58.728392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:01:58.728622 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== get_connector_properties: return (75ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:01:58.728817 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating existing volume attachment record: 833b9652-f1ff-43d9-8518-a9c4574e8cc2 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:01:58.835486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:01:58.926013 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:58.950747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.408s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:58.951495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:01:58.954679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:58.959030 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:01:58.959248 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Claim successful on node np0000001388
May 26 05:01:58.993515 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:01:59.115802 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attempting a stable device rescue
May 26 05:01:59.141464 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:01:59.210225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 05:01:59.213628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:01:59.213754 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Creating image(s)
May 26 05:01:59.214337 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:59.214488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:59.215265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:01:59.215434 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'trusted_certs' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:01:59.458298 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:01:59.458792 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:01:59.458792 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:59.458927 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:01:59.643839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1525e7-3159-48bd-bcf9-4356f1bf20de req-bab5e4c1-e69d-438d-96b4-bd384e2c9096 service nova] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:01:59.644489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:01:59.644816 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:01:59.654139 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37820297b6154d5cab2a158004754721', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba1a070782e1452690c54eb9a95cb8d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:01:59.717143 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:01:59.717572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:01:59.718050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:01:59.961525 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:02:00.171590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:00.171794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:00.255645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully created port: a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:00.267898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:00.496997 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:00.517041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:00.517442 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:00.653625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:00.653865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:00.654306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:00.654306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:00.654420 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:00.654615 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-23280d1b-dcd5-4510-a17b-44af62a2fc71 req-9633ff20-d65a-49c6-8d7b-196ac8664a98 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state active and task_state rescuing.
May 26 05:02:00.658857 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:00.675006 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:02:00.803534 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:00.807341 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:00.809638 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully created port: ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:00.810886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:00.855538 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:00.857007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:00.857285 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Creating image(s)
May 26 05:02:00.857663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:02:00.857791 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Ensure instance console log exists: /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:00.858031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:00.858317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:00.858385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:00.901804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.part --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:00.902154 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] 8fe29398-d7dd-4893-a0df-bfc13068a4ba was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:02:00.903284 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:02:00.903457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.part /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:01.022079 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:01.085053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.part /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.converted" returned: 0 in 0.181s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:01.101552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:01.163301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:01.163301 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance network_info: |[{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:01.164306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start _get_guest_xml network_info=[{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '833b9652-f1ff-43d9-8518-a9c4574e8cc2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ec4ecad1-7f2e-4026-b3c5-be40769b3a19', 'attached_at': '', 'detached_at': '', 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'serial': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:01.166599 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:01.168068 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-696737626', uuid='ec4ecad1-7f2e-4026-b3c5-be40769b3a19'), owner=OwnerMeta(userid='e78b48c4b4dc439086e392b4800b4ad7', username='tempest-ServerActionsTestOtherA-846952046-project-member', projectid='278ea77812db4e90a14904f104739285', projectname='tempest-ServerActionsTestOtherA-846952046'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771721.1676176) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:01.169466 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:01.169869 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:01.170649 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:01.170844 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:01.171945 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:01.172273 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:01.172480 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:01.172566 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:01.172698 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:01.172772 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:01.172860 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:01.173028 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:01.173122 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:01.173253 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:01.173366 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:01.173481 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:01.193448 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb.converted --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:01.194713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.477s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:01.195164 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:01.208504 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:01.209241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:01.209685 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:01.209900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:01.212647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:01.213172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:01.213450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:01.213780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:01.214163 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:01.221106 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:01.221106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:01.235788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:01.240045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:01.241041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:01.241338 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:01.242412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:01.242412 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:01.254608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:01.254608 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:01.261666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:01.261666 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:01.270364 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f] added
May 26 05:02:01.270364 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:01.270364 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:01.270364 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:01.270364 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:01.270364 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:01.270364 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:01.270600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:01.270783 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:01.270941 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:01.274541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f] added
May 26 05:02:01.274541 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:01.274541 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:01.274541 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:01.274541 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:01.274541 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:01.274541 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:01.274809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:01.274926 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:01.275186 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:01.278263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:01.299320 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully created port: e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:01.315560 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:01.316018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb,backing_fmt=raw /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:01.374237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/838d90da0334d259335f1f9c4b5a76d2d6740ddb,backing_fmt=raw /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.rescue" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:01.374752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "838d90da0334d259335f1f9c4b5a76d2d6740ddb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:01.375111 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'migration_context' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:01.391398 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00046611500010840246 future=<Future at 0x7d7aa44bb980 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:01.391817 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:01.392027 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.213053013999797 future=<Future at 0x7d7aa422bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:01.392670 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Emitting event <LifecycleEvent: 1779771706.3908107, 20ac28c7-02f1-416e-a5f5-aef40de54382 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:01.392899 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.212196945999949 future=<Future at 0x7d7aa422bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:01.393039 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] VM Stopped (Lifecycle Event)
May 26 05:02:01.472111 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:02:01.532889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.582s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:01.534019 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.819s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:01.534292 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:02:01.540481 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:02:01.541028 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Claim successful on node np0000001388
May 26 05:02:01.742280 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:01.843924 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully created port: 76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:01.877801 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:01.878080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:02:01.880740 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start _get_guest_xml network_info=[{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "vif_mac": "fa:16:3e:d2:77:67"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8fe29398-d7dd-4893-a0df-bfc13068a4ba', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'f8c998cf-2ce4-45d8-ba17-5c800685769d', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'e91a9807-3af1-440f-8391-32c1221de940', 'attached_at': '', 'detached_at': '', 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'serial': '679d5805-0f4b-4723-a37c-a22d58f43594'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:01.880740 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'resources' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:01.898123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: 20ac28c7-02f1-416e-a5f5-aef40de54382] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:01.927475 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:01.982354 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Booting with volume 7ec8dd0f-0f02-43c8-9519-11307e31b4b9 at /dev/vda
May 26 05:02:02.033046 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:02.042395 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:02:02.042395 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:02:02.042593 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:02.042868 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:02.047158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:02:02.082182 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:02.126167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:02:02.126553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:02:02.136048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:02:02.138293 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 05:02:02.140565 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:02:02.140738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:02:02.141146 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:02.141360 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating existing volume attachment record: 37b40451-d947-4b6c-bc75-ff81d9d14ac2 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:02:02.146739 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f55e5be56ba5425eab028cfc593a866f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e6f813ccf14854b9ea9a5a58629736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:02:02.271461 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:02.277638 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:02.284645 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:02.284645 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:02.294651 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:02.294651 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.305302 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully created port: e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:02.307808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.308756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.321799 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:02.326267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.326267 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.326267 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.326267 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:02.326629 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.326629 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.326629 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.326629 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:02.357464 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260]
May 26 05:02:02.357464 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260] successful.
May 26 05:02:02.357464 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.362302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260]
May 26 05:02:02.362302 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260] successful.
May 26 05:02:02.362302 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.371955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.379095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:02.382993 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:02.385854 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:02.387644 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerStableDeviceRescueTest-server-823898949', uuid='e91a9807-3af1-440f-8391-32c1221de940'), owner=OwnerMeta(userid='08922d29201545f0ba67ae8ac1eb77e6', username='tempest-ServerStableDeviceRescueTest-1077407970-project-member', projectid='07c7eafe2c8f4d5bac4c03e3968605a2', projectname='tempest-ServerStableDeviceRescueTest-1077407970'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "vif_mac": "fa:16:3e:d2:77:67"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771722.3871634) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:02.388945 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:02.389509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:02.393588 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:02.395599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.395599 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.395599 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.395599 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.395599 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.395599 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:02.395802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.395802 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.395802 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.395802 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.395802 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.395802 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:02.396324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:02.396451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:02.397240 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.397240 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.397240 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.397240 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.397240 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.397240 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:02.397513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.397513 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:02.397513 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:02.397513 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.397513 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:02.397513 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:02.397811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:02.398229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:02.398399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:02.399521 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:02.399983 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:02.400183 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:02.400343 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:02.400539 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:02.400680 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:02.400836 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:02.401053 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:02.401467 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:02.401735 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:02.401883 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:02.402055 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:02.402481 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'vcpu_model' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:02.405237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('8', '-', '-', 0) found on session 43 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:02.405434 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:02.409015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('11', '-', '-', 0) found on session 44 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:02.409158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:02.423921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 43 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:02.423921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:02.433447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 44 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:02.433447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:02.545189 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:02:02.727941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:02.727941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:02.913866 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:02.927975 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:03.025210 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:03.031768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:03.032358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:03.032645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:03.034035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:03.034603 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:03.034916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:03.035112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:03.057258 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:02:03.079596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:03.080092 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-a183d9a1-bb48-426b-8663-8113a1e6df94. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:03.080336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:03.080739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:03.081048 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:03.121412 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:03.121638 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:03.238079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:02:03.241746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:02:03.296677 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Successfully created port: 416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:03.590458 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:03.627843 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:03.782361 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Booting with volume 154572d8-867e-4056-bf4e-d87fcb2cacd8 at /dev/vdb
May 26 05:02:03.792611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:03.831297 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:03.834617 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Successfully updated port: 416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:03.838734 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:03.848156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:02:03.875784 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:03.914542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:02:03.914813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:02:03.924811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:02:03.926043 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 05:02:03.926177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:02:03.926316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:02:03.926593 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:03.926859 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating existing volume attachment record: d0c08ea6-0173-469f-af7c-9acb67f618cc {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:02:04.028851 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:04.071896 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:04.073299 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:04.074263 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Creating image(s)
May 26 05:02:04.074263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:04.074263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:04.075282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:04.075282 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:04.078562 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:04.080543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:04.137536 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:04.142218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.607s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:04.142218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:02:04.144560 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.866s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:04.149860 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:02:04.150029 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Claim successful on node np0000001388
May 26 05:02:04.174934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:04.175381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:04.175835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:04.176339 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:04.178772 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:04.179826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:04.216345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:04.216526 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:04.216864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:04.259666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found WWN 3300000001daa20bc for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:04.260452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:04.260452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== connect_volume: return (3050ms) {'type': 'block', 'scsi_wwn': '3300000001daa20bc', 'path': '/dev/dm-1', 'multipath_id': '3300000001daa20bc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:04.260452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001daa20bc', 'path': '/dev/dm-1', 'multipath_id': '3300000001daa20bc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:04.261750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.226s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:04.261750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:04.265128 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:04.265624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:04.282308 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:04.285918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:04.287651 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:04.290376 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:04.292306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:04.292505 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:04.303142 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:04.303142 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:04.310010 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:04.310010 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:04.317579 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:04.323305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk 1073741824" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:04.324845 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:04.325538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:04.326016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:04.340264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:04.340422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquired lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:04.340695 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:04.344802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.344802 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.344802 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:04.344802 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.344802 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.344802 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:04.345118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.345118 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.345118 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:04.345118 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.345118 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.345118 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:04.345938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:04.346169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:04.346966 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.346966 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.346966 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:04.346966 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.346966 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.346966 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:04.347178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.347178 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:04.347178 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:04.347178 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.347178 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:04.347178 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:04.347582 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.055s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:04.347731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:04.348718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] HCTL ('9', '0', '0', 0) found on session 40 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:04.348905 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:04.356096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] HCTL ('10', '0', '0', 0) found on session 41 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:04.356380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:04.366305 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching for a device in session 40 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:04.366524 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:04.369955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Searching for a device in session 41 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:04.369955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:04.420618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:04.421080 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:02:04.421382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:04.521893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:04.523025 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Cannot resize image /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:02:04.523025 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:02:04.523025 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Ensure instance console log exists: /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:04.523265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:04.523427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:04.523611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:04.535478 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4dd208d3-108e-423d-be43-741d65830c36 req-2dfec8b2-bb75-49e4-9092-c0677f331ee1 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:04.537749 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:04.537749 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:04.652465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:02:04.652955 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:02:04.653322 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:04.653679 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:04.751724 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59079210c217429e88a1c824524b9772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d47b7a83249e09dab2cfa30367843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:02:04.779820 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:04.779820 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:04.780318 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:04.781890 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'pci_devices' on Instance uuid ec4ecad1-7f2e-4026-b3c5-be40769b3a19 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:04.945282 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:05.039304 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:05.127451 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:05.154303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-changed-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:05.157247 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Refreshing instance network info cache due to event network-changed-416ceb1f-c598-4997-a912-b80aaab260d1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:05.157247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] Acquiring lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:05.161042 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:02:05.282741 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:05.289873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <uuid>ec4ecad1-7f2e-4026-b3c5-be40769b3a19</uuid>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <name>instance-00000014</name>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-696737626</nova:name>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:01</nova:creationTime>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:user uuid="e78b48c4b4dc439086e392b4800b4ad7">tempest-ServerActionsTestOtherA-846952046-project-member</nova:user>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:project uuid="278ea77812db4e90a14904f104739285">tempest-ServerActionsTestOtherA-846952046</nova:project>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         <nova:port uuid="0f10a0b5-86a5-4382-99e5-e170ea108458">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="serial">ec4ecad1-7f2e-4026-b3c5-be40769b3a19</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="uuid">ec4ecad1-7f2e-4026-b3c5-be40769b3a19</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <alias name="ua-5af35d79-38f2-4c5a-bfc7-61d05f88f05f"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <serial>5af35d79-38f2-4c5a-bfc7-61d05f88f05f</serial>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:9a:19:9a"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <target dev="tap0f10a0b5-86"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/console.log" append="off"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:05.289873 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:05.292997 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Preparing to wait for external event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:05.292997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:05.292997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:05.292997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:05.295654 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:05.297141 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:05.298887 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:05.299744 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:05.301052 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.301592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:05.301886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:05.304898 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.305117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e60c815e-c8d1-55bf-954b-8e60ff3372bc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:05.306470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.307131 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:05.310088 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:05.315080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.322654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.323211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f10a0b5-86, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:05.324119 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f10a0b5-86, col_values=(('qos', UUID('24590e48-1a82-450f-83d5-c91d8e0271b0')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:05.324264 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f10a0b5-86, col_values=(('external_ids', {'iface-id': '0f10a0b5-86a5-4382-99e5-e170ea108458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:19:9a', 'vm-uuid': 'ec4ecad1-7f2e-4026-b3c5-be40769b3a19'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:05.326265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:02:05.329531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.331112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:05.349760 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:05.352348 np0000001388 nova-compute[98319]: INFO os_vif [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86')
May 26 05:02:05.371071 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Successfully created port: e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:05.415729 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:05.474591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:05.474830 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-ab88d52b-7850-42b4-9af0-733bf16b3461. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:05.474957 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:05.531886 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Booting with volume 9fac7c50-4cb1-491c-b359-35726050ee98 at /dev/vdc
May 26 05:02:05.552427 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Updating instance_info_cache with network_info: [{"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:05.581483 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:05.594694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:02:05.618940 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:05.670983 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:02:05.677095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:02:05.677531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:02:05.686263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:02:05.688718 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792'] 
May 26 05:02:05.688718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:02:05.688718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:02:05.688718 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:05.688718 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating existing volume attachment record: d1711f98-ec19-49b3-b28d-9acd3fe2b965 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:02:05.808408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:05.808770 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:05.921815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43523f76-0465-4fc5-868e-2277ae4ac09c req-271cc145-60e9-4ca3-a8ad-1c2ffc756491 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:05.923292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:05.924121 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:05.986280 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Successfully updated port: e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:06.060397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Releasing lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:06.060700 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Instance network_info: |[{"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:06.063054 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Start _get_guest_xml network_info=[{"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:06.063976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] Acquired lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:06.064275 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Refreshing network info cache for port 416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:06.066160 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:06.068332 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-95886711', uuid='b376e915-7cc0-44a9-b4ea-f9921835db8f'), owner=OwnerMeta(userid='f55e5be56ba5425eab028cfc593a866f', username='tempest-VolumesActionsTest-320780185-project-member', projectid='90e6f813ccf14854b9ea9a5a58629736', projectname='tempest-VolumesActionsTest-320780185'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771726.0674722) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:06.069325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:06.069739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:06.070976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:06.070976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:06.071803 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:06.072282 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:06.073024 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:06.073165 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:06.073372 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:06.073517 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:06.073661 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:06.074069 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:06.074235 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:06.074405 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:06.074566 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:06.074753 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:06.092887 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-95886711',display_name='tempest-VolumesActionsTest-instance-95886711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-95886711',id=22,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-8ozydyrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:03Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=b376e915-7cc0-44a9-b4ea-f9921835db8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:06.093146 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:06.094062 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:06.096696 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lazy-loading 'pci_devices' on Instance uuid b376e915-7cc0-44a9-b4ea-f9921835db8f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:06.313983 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:06.344901 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:06.348847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Found WWN 33000000050e736e4 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:06.349484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.088s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:06.349484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] <== connect_volume: return (3314ms) {'type': 'block', 'scsi_wwn': '33000000050e736e4', 'path': '/dev/dm-0', 'multipath_id': '33000000050e736e4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:06.349755 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000050e736e4', 'path': '/dev/dm-0', 'multipath_id': '33000000050e736e4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:06.426839 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:06.488471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:06.488600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquired lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:06.488756 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:06.522346 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:06.569386 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:06.600569 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <uuid>b376e915-7cc0-44a9-b4ea-f9921835db8f</uuid>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <name>instance-00000016</name>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-95886711</nova:name>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:06</nova:creationTime>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:user uuid="f55e5be56ba5425eab028cfc593a866f">tempest-VolumesActionsTest-320780185-project-member</nova:user>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:project uuid="90e6f813ccf14854b9ea9a5a58629736">tempest-VolumesActionsTest-320780185</nova:project>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         <nova:port uuid="416ceb1f-c598-4997-a912-b80aaab260d1">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="serial">b376e915-7cc0-44a9-b4ea-f9921835db8f</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="uuid">b376e915-7cc0-44a9-b4ea-f9921835db8f</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.config"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a2:90:9e"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <target dev="tap416ceb1f-c5"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/console.log" append="off"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:06.600569 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Preparing to wait for external event network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-95886711',display_name='tempest-VolumesActionsTest-instance-95886711',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-95886711',id=22,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-8ozydyrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:03Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=b376e915-7cc0-44a9-b4ea-f9921835db8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:06.602961 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:06.603462 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:06.604464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.604817 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:06.604991 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:06.606010 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.606010 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afada34d-1772-5daf-9f27-781849ea1585', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:06.607578 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.607907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:06.621614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.625446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.626570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap416ceb1f-c5, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:06.628886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap416ceb1f-c5, col_values=(('qos', UUID('e74c77cc-a010-453f-b2b7-aba002454cb2')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:06.629615 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap416ceb1f-c5, col_values=(('external_ids', {'iface-id': '416ceb1f-c598-4997-a912-b80aaab260d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:90:9e', 'vm-uuid': 'b376e915-7cc0-44a9-b4ea-f9921835db8f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:06.631330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.633816 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:06.653037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.655921 np0000001388 nova-compute[98319]: INFO os_vif [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5')
May 26 05:02:06.685190 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:06.686635 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:06.686900 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Creating image(s)
May 26 05:02:06.687369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:06.687517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:06.688043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:06.688798 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:06.693094 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:06.694107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:06.726669 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:06.743439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:06.787394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:06.788035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:06.790223 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:06.790382 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:06.794925 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:06.795555 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:06.829137 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.684s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:06.829974 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:02:06.834186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:06.839935 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:02:06.840887 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Claim successful on node np0000001388
May 26 05:02:06.855090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-823898949',display_name='tempest-ServerStableDeviceRescueTest-server-823898949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverstabledevicerescuetest-server-823898949',id=17,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/FSn7oCJKnrgir3Rk3qBJB6LzlthHaQG+MECR8g/zke6XlHvpe8f/iQIhXCBT1ggZdEvzhejIaU5Vtr2GJY/bHcc8BNXq/EpE4MAfDnvkL+HN1Sgqoah5w1Eh65Hl9w==',key_name='tempest-keypair-303946473',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:00:55Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7eafe2c8f4d5bac4c03e3968605a2',ramdisk_id='',reservation_id='r-h3x8rum0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1077407970',owner_user_name='tempest-ServerStableDeviceRescueTest-1077407970-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:01:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08922d29201545f0ba67ae8ac1eb77e6',uuid=e91a9807-3af1-440f-8391-32c1221de940,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "vif_mac": "fa:16:3e:d2:77:67"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:06.855376 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converting VIF {"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "vif_mac": "fa:16:3e:d2:77:67"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:06.856067 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:06.857076 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'pci_devices' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:06.878366 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:06.878601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:06.878744 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:9a:19:9a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:06.879306 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Using config drive
May 26 05:02:06.890122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:06.890979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:06.948258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:06.948744 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:06.949042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:07.050690 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.052678 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:07.053139 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:02:07.053491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:07.084142 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:07.153308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:07.153854 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Cannot resize image /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:02:07.154368 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:02:07.154829 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Ensure instance console log exists: /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:07.155363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:07.155654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:07.156041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:07.231074 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:07.235967 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-ba67c92e-9ff7-41fa-9a12-c8043357b83b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:07.236167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:07.236311 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-176be5f5-0917-4256-b497-c012c8eca190 req-9f70c0cd-e971-47a6-a2a3-9de9bfdf6777 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:07.236758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:07.236884 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:07.299950 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.317155 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Updated VIF entry in instance network info cache for port 416ceb1f-c598-4997-a912-b80aaab260d1. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:07.317694 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Updating instance_info_cache with network_info: [{"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:07.338228 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:02:07.340831 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:02:07.340831 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.340831 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.361629 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:07.363124 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <uuid>e91a9807-3af1-440f-8391-32c1221de940</uuid>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <name>instance-00000011</name>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-823898949</nova:name>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:02</nova:creationTime>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:user uuid="08922d29201545f0ba67ae8ac1eb77e6">tempest-ServerStableDeviceRescueTest-1077407970-project-member</nova:user>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:project uuid="07c7eafe2c8f4d5bac4c03e3968605a2">tempest-ServerStableDeviceRescueTest-1077407970</nova:project>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         <nova:port uuid="99f251d1-253d-4cbe-8b08-c3a4a9ac5f19">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="serial">e91a9807-3af1-440f-8391-32c1221de940</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="uuid">e91a9807-3af1-440f-8391-32c1221de940</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <alias name="ua-679d5805-0f4b-4723-a37c-a22d58f43594"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <serial>679d5805-0f4b-4723-a37c-a22d58f43594</serial>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.rescue"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <boot order="1"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:d2:77:67"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <target dev="tap99f251d1-25"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/console.log" append="off"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:07.363124 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:07.370374 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance destroyed successfully.
May 26 05:02:07.396414 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.441771 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b28a85d2f1144c9913761b58832f46e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa36a5abcae34ede974ef08e44316802', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:02:07.502025 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:07.517794 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating instance_info_cache with network_info: [{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:07.562044 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Creating config drive at /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config
May 26 05:02:07.570222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwfrfqtcc {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:07.589320 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-changed-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:07.589576 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Refreshing instance network info cache due to event network-changed-e9ada007-95ef-495c-83fe-e5e42726bda7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:07.589851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] Acquiring lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:07.624539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpwfrfqtcc" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:07.739331 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:07.819896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c2ebbab2-5ff9-4cae-832e-cdb1b952859f req-bd539825-f53b-4b2c-9199-9d05c668dff2 service nova] Releasing lock "refresh_cache-b376e915-7cc0-44a9-b4ea-f9921835db8f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:07.829939 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:07.832401 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:07.832845 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Creating image(s)
May 26 05:02:07.833686 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:02:07.834009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Ensure instance console log exists: /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:07.834445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:07.835089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:07.835532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:07.841567 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:07.843313 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:02:08.025830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Releasing lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:08.027423 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Instance network_info: |[{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:08.029307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Start _get_guest_xml network_info=[{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:08.030649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] Acquired lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:08.031444 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Refreshing network info cache for port e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:08.050051 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:08.051780 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-1755426010', uuid='71b40a96-611b-4143-a895-e464b0ce391d'), owner=OwnerMeta(userid='59079210c217429e88a1c824524b9772', username='tempest-VolumesBackupsTest-2047315277-project-member', projectid='c32d47b7a83249e09dab2cfa30367843', projectname='tempest-VolumesBackupsTest-2047315277'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771728.0502405) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:08.057652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:08.061814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:08.268867 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Successfully created port: f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:08.298972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.301697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:08.311719 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:08.313102 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:08.313591 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:08.314001 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:08.314001 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:08.314300 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:08.314383 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:08.314640 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:08.314712 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:08.314858 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:08.315014 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:08.315161 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:08.315335 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:08.328666 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.333362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.333362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] No VIF found with MAC fa:16:3e:a2:90:9e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:08.333362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1755426010',display_name='tempest-VolumesBackupsTest-instance-1755426010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-1755426010',id=23,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0kjC/yUfLG2hQWvosPDwQa6+BEcuTQ0S7AUG6ep6VaM5EgLQTPYg1QAqASJeWYcIAuLz3jm2Tdm/8WhmwtiWAwwndtwr0kzrrCQyJimmZxJ5e4DyrRF7nJKKmwE6Ju6w==',key_name='tempest-keypair-1953515033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-kz1yjg5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=71b40a96-611b-4143-a895-e464b0ce391d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:08.333362 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:08.333362 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:08.333798 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'pci_devices' on Instance uuid 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:08.337485 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Using config drive
May 26 05:02:08.338713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.358611 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:02:08.450815 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a7e61aa9-c324-49f3-b042-30b50fd266df req-df619686-4aa5-48b9-a129-d47332005029 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:08.450815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7e61aa9-c324-49f3-b042-30b50fd266df req-df619686-4aa5-48b9-a129-d47332005029 service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:08.450815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7e61aa9-c324-49f3-b042-30b50fd266df req-df619686-4aa5-48b9-a129-d47332005029 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:08.450815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a7e61aa9-c324-49f3-b042-30b50fd266df req-df619686-4aa5-48b9-a129-d47332005029 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:08.451649 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a7e61aa9-c324-49f3-b042-30b50fd266df req-df619686-4aa5-48b9-a129-d47332005029 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Processing event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:08.460316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.468021 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:08.469909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.541190 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:08.714652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:08.714917 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:08.843237 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <uuid>71b40a96-611b-4143-a895-e464b0ce391d</uuid>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <name>instance-00000017</name>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesBackupsTest-instance-1755426010</nova:name>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:08</nova:creationTime>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:user uuid="59079210c217429e88a1c824524b9772">tempest-VolumesBackupsTest-2047315277-project-member</nova:user>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:project uuid="c32d47b7a83249e09dab2cfa30367843">tempest-VolumesBackupsTest-2047315277</nova:project>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         <nova:port uuid="e9ada007-95ef-495c-83fe-e5e42726bda7">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="serial">71b40a96-611b-4143-a895-e464b0ce391d</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="uuid">71b40a96-611b-4143-a895-e464b0ce391d</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.config"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:fc:c9:eb"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <target dev="tape9ada007-95"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/console.log" append="off"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:08.843237 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Preparing to wait for external event network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1755426010',display_name='tempest-VolumesBackupsTest-instance-1755426010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-1755426010',id=23,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0kjC/yUfLG2hQWvosPDwQa6+BEcuTQ0S7AUG6ep6VaM5EgLQTPYg1QAqASJeWYcIAuLz3jm2Tdm/8WhmwtiWAwwndtwr0kzrrCQyJimmZxJ5e4DyrRF7nJKKmwE6Ju6w==',key_name='tempest-keypair-1953515033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-kz1yjg5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=71b40a96-611b-4143-a895-e464b0ce391d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:08.847782 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:08.851976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.853484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:08.854153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:08.855211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.861583 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:08.865511 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb4203f3-ed0f-52e1-acae-f35cba6f410c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:08.866302 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Booting with volume b33f67c7-7b54-41bc-92fb-67edd8113c29 at /dev/vda
May 26 05:02:08.877252 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:08.882947 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.887263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.887610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9ada007-95, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:08.888041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9ada007-95, col_values=(('qos', UUID('b18ff5f9-8244-4096-941a-6ec0465a2407')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:08.888244 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9ada007-95, col_values=(('external_ids', {'iface-id': 'e9ada007-95ef-495c-83fe-e5e42726bda7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:c9:eb', 'vm-uuid': '71b40a96-611b-4143-a895-e464b0ce391d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:08.889860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.894642 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:08.899753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.900614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.900614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.900614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:08.900614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] No VIF found with MAC fa:16:3e:d2:77:67, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:08.901745 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Using config drive
May 26 05:02:08.912891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:08.916685 np0000001388 nova-compute[98319]: INFO os_vif [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95')
May 26 05:02:08.930936 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:08.944938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:02:08.955019 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: 76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:08.972553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1a13f5ad-bd5f-4a41-8b29-63aeb303771c req-c0c1d237-5253-48fe-a3bd-8363fe918483 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:08.980163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:09.011704 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:09.029207 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:02:09.029613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:02:09.039802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:02:09.041226 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fe9a:199a'] 
May 26 05:02:09.041504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:02:09.041710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:02:09.042041 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:09.045234 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating existing volume attachment record: 3302adfa-4abe-4a4c-8c77-718783a2a6d9 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:02:09.075224 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Creating config drive at /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.config
May 26 05:02:09.079986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfyvhayh3 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:09.149315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfyvhayh3" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:09.220337 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:09.240429 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updated VIF entry in instance network info cache for port e9ada007-95ef-495c-83fe-e5e42726bda7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:09.243050 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating instance_info_cache with network_info: [{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:09.244047 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:09.245641 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771729.2443452, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:09.245641 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Started (Lifecycle Event)
May 26 05:02:09.248953 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:09.258375 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance spawned successfully.
May 26 05:02:09.265558 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Successfully updated port: f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:09.269840 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:09.406877 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'ec2_ids' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:09.445422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:09.445422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-e93d6144-2bb7-4826-b780-4de24fb838f7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:09.445422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:09.445422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:09.445422 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:09.728401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.894s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:09.728820 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:02:09.748997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d551d127-0f88-4de9-9ef5-4db3429b32bf req-6289212e-cfac-4a7b-82c1-de7f4ea0e43e service nova] Releasing lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:09.753419 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:09.757780 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:09.767975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:09.777590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:09.777590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:09.777824 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:09.782677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.782677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.782677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.782677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.782677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.783046 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:09.807970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:09.911817 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:09.911817 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'keypairs' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:09.918054 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:09.948354 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:10.115981 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:10.237879 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:02:10.239723 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:02:10.242420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:10.244395 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:10.244726 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:10.249271 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:10.252856 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:10.269872 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:02:10.273846 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771730.2731361, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:10.273846 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Paused (Lifecycle Event)
May 26 05:02:10.292091 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Took 9.44 seconds to spawn the instance on the hypervisor.
May 26 05:02:10.292512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:10.294007 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:10.311224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:10.357127 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03dbcb5077f54cfb92f9af2ed9e51ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6947ca5ef3684f329c6584405e98f535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:02:10.388621 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:10.413060 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:10.427518 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:10.435984 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:10.441670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:10.441975 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:10.442127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:10.442303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:10.446310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:10.446551 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-63e7e6af-2917-4885-a5a0-044a6281d4f9 req-cbc2b37a-bc24-4adc-9d5e-682254526081 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 for instance with vm_state building and task_state spawning.
May 26 05:02:10.456461 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:10.457293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:10.457293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No VIF found with MAC fa:16:3e:fc:c9:eb, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:10.457539 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Using config drive
May 26 05:02:10.708402 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Successfully updated port: e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:10.748817 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:02:10.778844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:10.785592 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Creating config drive at /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config.rescue
May 26 05:02:10.790879 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771730.790564, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:10.791002 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Resumed (Lifecycle Event)
May 26 05:02:10.803831 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfb1gp7rv {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:10.846142 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:10.849076 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Took 16.79 seconds to build instance.
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:10.861355 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received unexpected event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with vm_state active and task_state None.
May 26 05:02:10.861814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:10.861814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing instance network info cache due to event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:10.861814 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:10.882340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfb1gp7rv" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:10.894842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:10.895019 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:10.895159 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-76837440-e063-400b-9639-ffafb76b64bd. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:10.895358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:10.895464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:10.895624 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port 76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:10.966604 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:11.040002 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:11.071135 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Successfully created port: f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:02:11.165411 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Creating config drive at /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.config
May 26 05:02:11.169106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc8qji_tj {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:11.194645 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:11.200061 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:11.201994 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Creating image(s)
May 26 05:02:11.202382 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:02:11.202545 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Ensure instance console log exists: /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:11.202843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:11.203139 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:11.203310 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:11.212824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:11.233261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpc8qji_tj" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:11.258995 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:02:11.297074 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:11.301276 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:11.353152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd545db8-2f62-440c-8f8c-0a75f6c5b87f tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.303s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:11.398472 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:11.496715 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:11.530693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.543631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:11.544288 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Instance network_info: |[{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:11.544973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:11.545786 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:11.546684 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Start _get_guest_xml network_info=[{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '3302adfa-4abe-4a4c-8c77-718783a2a6d9', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '833f5c94-6742-454b-a72e-75930e6b3aff', 'attached_at': '', 'detached_at': '', 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'serial': 'b33f67c7-7b54-41bc-92fb-67edd8113c29'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:11.549548 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:11.549831 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:11.550179 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:11.550445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:11.550602 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Processing event network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:11.550825 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:11.551033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:11.551244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:11.551418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:11.551624 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] No waiting events found dispatching network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:11.551799 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-84ffa539-3ae2-4969-99ab-688b34445391 req-32eb38c0-b526-43d7-84ba-46dbabef9856 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received unexpected event network-vif-plugged-416ceb1f-c598-4997-a912-b80aaab260d1 for instance with vm_state building and task_state spawning.
May 26 05:02:11.555631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:11.557462 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:11.558967 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBackupRestore-server-1843753624', uuid='833f5c94-6742-454b-a72e-75930e6b3aff'), owner=OwnerMeta(userid='4b28a85d2f1144c9913761b58832f46e', username='tempest-TestVolumeBackupRestore-2077017730-project-member', projectid='fa36a5abcae34ede974ef08e44316802', projectname='tempest-TestVolumeBackupRestore-2077017730'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771731.5586035) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:11.562684 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:11.565748 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:11.566090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:11.567535 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:11.567758 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:11.568771 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:11.572460 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:11.575938 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.576106 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Instance spawned successfully.
May 26 05:02:11.576417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:11.576516 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:11.576720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:11.576720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:11.576909 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:11.577060 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:11.577244 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:11.577353 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:11.577489 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:11.577672 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:11.583772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:11.599071 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:11.599484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:11.599672 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:11.600397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:11.600682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:11.615560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:11.616424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:11.617102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:11.617450 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:11.618638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:11.618638 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:11.629658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:11.629658 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:11.641515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:11.641515 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:11.649102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29] added
May 26 05:02:11.649102 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:11.649102 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:11.649102 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:11.649102 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:11.649102 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:11.649102 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:11.649440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:11.649473 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0322(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:11.649630 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:11.661707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29] added
May 26 05:02:11.661707 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:11.661707 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:11.661707 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:11.661707 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:11.661707 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:11.661707 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:11.661901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:11.662026 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0436(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:11.662130 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:11.745352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.791034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.805930 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771731.805548, b376e915-7cc0-44a9-b4ea-f9921835db8f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:11.806079 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] VM Started (Lifecycle Event)
May 26 05:02:11.829735 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Successfully updated port: f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:02:11.858357 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:11.953974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.962826 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.970626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:11.998607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.003329 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.050932 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:12.053102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.080809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.107518 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.107677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.108037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.108503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.109541 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.109541 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:12.189912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.278981 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:02:12.286567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:02:12.287753 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Creating image(s)
May 26 05:02:12.288263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.288440 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.289033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.289334 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:12.292919 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:12.296581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:12.320801 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:12.327573 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:12.333647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:12.333647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:12.333647 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:12.362405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92ff6a05-5933-481b-a417-a3869ff35e93 req-500c1e60-be32-4f00-ae60-a1ebb5165ebd service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:12.364525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:12.364785 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:12.405749 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:12.406422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.406890 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.407390 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:12.411494 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:02:12.411912 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:12.521593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:12.523839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:12.564522 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:12.565964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.566322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.566507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.568229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:12.568229 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 for instance with vm_state building and task_state spawning.
May 26 05:02:12.568229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:12.568229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-e945b3df-400c-4c78-a398-1e41795b4479. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:12.568229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:12.579572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.585255 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.587855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk 1073741824" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:12.588698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.589421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:12.612545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:12.621978 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Took 8.55 seconds to spawn the instance on the hypervisor.
May 26 05:02:12.621978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:12.647753 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:12.650975 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:12.664265 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:12.664265 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.667182 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:12.684658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:12.697031 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:12.697031 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.709878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.709878 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.709878 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.709878 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.709878 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.709878 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:12.710163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.710163 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.710163 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.710163 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.710163 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.710163 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:12.721285 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.721414 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.132s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:12.722126 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:02:12.722501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:12.741008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.741008 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.741008 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.741008 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.741008 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.741008 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:12.741355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.741355 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.741355 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.741355 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.741355 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.741355 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:12.766483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.40.100,3260]
May 26 05:02:12.766483 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.40.100,3260] successful.
May 26 05:02:12.766483 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.782226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.791188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.50.100,3260]
May 26 05:02:12.791188 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.50.100,3260] successful.
May 26 05:02:12.791188 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.801633 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.801905 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:12.802470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:12.802653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:12.806633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] HCTL ('12', '-', '-', 0) found on session 45 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:12.806875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:12.807338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:12.827213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Searching for a device in session 45 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:12.827213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [42] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8469547a-c6e6-4318-bfae-cfec366d7f6e (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:12.831677 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:12.832142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.214s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:12.833466 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:12.838155 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:02:12.841237 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771732.8402154, b376e915-7cc0-44a9-b4ea-f9921835db8f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:12.841237 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] VM Paused (Lifecycle Event)
May 26 05:02:12.852413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] HCTL ('13', '-', '-', 0) found on session 46 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:12.852413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:12.853117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:12.853641 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Cannot resize image /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:02:12.854998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:02:12.854998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Ensure instance console log exists: /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:12.854998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.855165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.855224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.869365 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updated VIF entry in instance network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:12.869979 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:12.887063 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Searching for a device in session 46 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:12.924069 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:12.924400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.925773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.926394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.927118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:12.927350 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state active and task_state rescuing.
May 26 05:02:12.928095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:12.928446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:12.929255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:12.929466 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:12.929610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:12.929764 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-43c05dcc-8b9c-47a7-ab81-b925d71c96ef req-e415c979-bcad-42ed-aa09-e7475b50305d service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state active and task_state rescuing.
May 26 05:02:12.962414 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:13.016160 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:02:13.152735 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Took 16.77 seconds to build instance.
May 26 05:02:13.160572 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-63f6b1a7-1d4a-44d2-972e-00c6862dc889 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:13.236828 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:13.286473 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:13.353277 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:13.359213 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771733.3583574, b376e915-7cc0-44a9-b4ea-f9921835db8f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:13.359213 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] VM Resumed (Lifecycle Event)
May 26 05:02:13.375941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e64f17b5-c067-4ca1-ac54-ae62e0297509 req-f7462364-e1d8-4e74-95de-ab88e72139dd service nova] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:13.485454 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:13.606044 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0008236839998971845 future=<Future at 0x7d7aa422bd70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:13.614596 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Emitting event <LifecycleEvent: 1779771718.6050048, e91a9807-3af1-440f-8391-32c1221de940 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:13.615025 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:13.617249 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Stopped (Lifecycle Event)
May 26 05:02:13.658373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.279s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:13.758562 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:13.764720 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-changed-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:13.766662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing instance network info cache due to event network-changed-f2a35255-f23f-4276-bb5a-924ea9ba2cc8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:13.766942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:13.863858 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:13.865510 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:13.884409 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Searching for a device in session 46 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:13.884661 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:13.889485 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:13.988621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:13.988686 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Instance network_info: |[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:13.990624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:13.990947 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing network info cache for port f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:13.991679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Start _get_guest_xml network_info=[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:13.994479 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:13.995934 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-156488668', uuid='02578b5c-b022-4d9a-ac22-3552d7e39881'), owner=OwnerMeta(userid='03dbcb5077f54cfb92f9af2ed9e51ba9', username='tempest-TaggedAttachmentsTest-811095965-project-member', projectid='6947ca5ef3684f329c6584405e98f535', projectname='tempest-TaggedAttachmentsTest-811095965'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771733.9955356) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:13.998682 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:13.998978 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:13.999846 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:14.000079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:14.001969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:14.003603 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:14.003603 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:14.003764 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:14.004689 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:14.004768 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:14.005182 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:14.005511 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:14.005825 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:14.005950 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:14.006055 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:14.006179 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:14.022267 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:14.023855 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:14.024653 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:14.025795 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'pci_devices' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:14.121019 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:14.132330 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:14.369454 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771734.3676424, e91a9807-3af1-440f-8391-32c1221de940 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:14.369454 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Resumed (Lifecycle Event)
May 26 05:02:14.438872 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:14.496027 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <uuid>02578b5c-b022-4d9a-ac22-3552d7e39881</uuid>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <name>instance-00000019</name>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:13</nova:creationTime>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="serial">02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="uuid">02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:68:cb:88"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <target dev="tapf2a35255-f2"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log" append="off"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:14.531527 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Preparing to wait for external event network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:14.531527 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:14.534613 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:14.534613 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:14.534613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.534613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:14.534613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:14.539605 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.539605 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59e91220-fcab-5d92-a9de-17058ab786ba', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:14.539932 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.540618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.542896 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.543089 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2a35255-f2, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:14.543529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2a35255-f2, col_values=(('qos', UUID('b48c6d8f-38ce-4702-a2ff-aa6786534012')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:14.543690 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2a35255-f2, col_values=(('external_ids', {'iface-id': 'f2a35255-f23f-4276-bb5a-924ea9ba2cc8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:cb:88', 'vm-uuid': '02578b5c-b022-4d9a-ac22-3552d7e39881'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:14.548172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.550506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:14.552395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:14.553469 np0000001388 nova-compute[98319]: INFO os_vif [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2')
May 26 05:02:14.647331 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Found WWN 330000000955f1491 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:14.647660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:14.648108 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '330000000955f1491', 'path': '/dev/dm-4', 'multipath_id': '330000000955f1491'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:14.648108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000955f1491', 'path': '/dev/dm-4', 'multipath_id': '330000000955f1491'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:14.751566 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 26 05:02:14.841222 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:14.871101 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:14.873887 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:14.895661 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:15.086897 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updated VIF entry in instance network info cache for port f2a35255-f23f-4276-bb5a-924ea9ba2cc8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:15.086897 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:15.158636 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1843753624',display_name='tempest-TestVolumeBackupRestore-server-1843753624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebackuprestore-server-1843753624',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOqKCE3dQ56x11GmmSAYA7F5qVo8S1wO1uL5jJ1mfGmdF8VgyPLWmI8MI4wJQIzEAdveygvazUBEG46kKnWeJ6GilNCoBPvh+nLWVL4WQ4WOhTZlsMYTvXFgAgDmxBt4w==',key_name='tempest-TestVolumeBackupRestore-1883569700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa36a5abcae34ede974ef08e44316802',ramdisk_id='',reservation_id='r-yt3bmkv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-2077017730',owner_user_name='tempest-TestVolumeBackupRestore-2077017730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:08Z,user_data=None,user_id='4b28a85d2f1144c9913761b58832f46e',uuid=833f5c94-6742-454b-a72e-75930e6b3aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:15.158636 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converting VIF {"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:15.158636 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:15.158636 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lazy-loading 'pci_devices' on Instance uuid 833f5c94-6742-454b-a72e-75930e6b3aff {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:15.251491 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Unrescuing
May 26 05:02:15.251740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:15.251901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:15.252085 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:15.267841 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:15.338792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.338958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.381086 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 05:02:15.381480 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771735.3811407, e91a9807-3af1-440f-8391-32c1221de940 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:15.383348 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Started (Lifecycle Event)
May 26 05:02:15.589871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:15.590822 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:15.590822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.590822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.590822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:15.590822 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Processing event network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:15.591071 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:15.591159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.591364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.591507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:15.591662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] No waiting events found dispatching network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:15.591821 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-c243a09f-ecef-4ee2-8fab-73c8941795b0 req-36cc0c38-0e16-4261-b447-456f177c1e01 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received unexpected event network-vif-plugged-e9ada007-95ef-495c-83fe-e5e42726bda7 for instance with vm_state building and task_state spawning.
May 26 05:02:15.592479 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:15.600312 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:15.604529 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Instance spawned successfully.
May 26 05:02:15.604992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:15.651362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.651545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.651751 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.652007 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.652158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:15.654311 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Terminating instance
May 26 05:02:15.663572 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <uuid>833f5c94-6742-454b-a72e-75930e6b3aff</uuid>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <name>instance-00000018</name>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBackupRestore-server-1843753624</nova:name>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:11</nova:creationTime>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:user uuid="4b28a85d2f1144c9913761b58832f46e">tempest-TestVolumeBackupRestore-2077017730-project-member</nova:user>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:project uuid="fa36a5abcae34ede974ef08e44316802">tempest-TestVolumeBackupRestore-2077017730</nova:project>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         <nova:port uuid="f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="serial">833f5c94-6742-454b-a72e-75930e6b3aff</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="uuid">833f5c94-6742-454b-a72e-75930e6b3aff</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/disk.config"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <alias name="ua-b33f67c7-7b54-41bc-92fb-67edd8113c29"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <serial>b33f67c7-7b54-41bc-92fb-67edd8113c29</serial>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:1b:75:ad"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <target dev="tapf02c97a4-f5"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/console.log" append="off"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:15.663572 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Preparing to wait for external event network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1843753624',display_name='tempest-TestVolumeBackupRestore-server-1843753624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebackuprestore-server-1843753624',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOqKCE3dQ56x11GmmSAYA7F5qVo8S1wO1uL5jJ1mfGmdF8VgyPLWmI8MI4wJQIzEAdveygvazUBEG46kKnWeJ6GilNCoBPvh+nLWVL4WQ4WOhTZlsMYTvXFgAgDmxBt4w==',key_name='tempest-TestVolumeBackupRestore-1883569700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fa36a5abcae34ede974ef08e44316802',ramdisk_id='',reservation_id='r-yt3bmkv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBackupRestore-2077017730',owner_user_name='tempest-TestVolumeBackupRestore-2077017730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:08Z,user_data=None,user_id='4b28a85d2f1144c9913761b58832f46e',uuid=833f5c94-6742-454b-a72e-75930e6b3aff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:15.666450 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converting VIF {"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:15.667080 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:15.667470 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:15.667624 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.667819 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:15.667907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:15.668608 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.668762 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9c5bcbc-6435-5dd4-b3ab-e0e671a0fca9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:15.669457 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.670362 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:15.675628 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.677865 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.678030 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf02c97a4-f5, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:15.678378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf02c97a4-f5, col_values=(('qos', UUID('a72bded6-78cc-4768-b1e8-d07567e078c1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:15.678543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf02c97a4-f5, col_values=(('external_ids', {'iface-id': 'f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:75:ad', 'vm-uuid': '833f5c94-6742-454b-a72e-75930e6b3aff'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:15.679324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.680715 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:15.691495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:15.692311 np0000001388 nova-compute[98319]: INFO os_vif [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5')
May 26 05:02:15.729476 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:15.754480 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:15.852077 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:02:15.852435 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Claim successful on node np0000001388
May 26 05:02:15.868100 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:15.869782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing instance network info cache due to event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:15.869782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:15.890755 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:15.892276 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:15.943989 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:16.074459 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:16.074516 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:16.074837 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No VIF found with MAC fa:16:3e:68:cb:88, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:16.075181 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Using config drive
May 26 05:02:16.117827 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.118171 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.118662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.118662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.118857 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.119138 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:16.167683 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:02:16.214410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.229125 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:16.248634 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.253031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.301219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.304373 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.368980 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating resource usage from migration d7db862c-5526-40d8-abfb-ad55b6554429
May 26 05:02:16.402534 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 05:02:16.402534 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771736.400119, 71b40a96-611b-4143-a895-e464b0ce391d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:16.402534 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] VM Started (Lifecycle Event)
May 26 05:02:16.446524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:16.447064 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance network_info: |[{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:02:16.448870 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Start _get_guest_xml network_info=[{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '37b40451-d947-4b6c-bc75-ff81d9d14ac2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d1d5287-dc50-4416-8e04-5f6cc47747ea', 'attached_at': '', 'detached_at': '', 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'serial': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'd0c08ea6-0173-469f-af7c-9acb67f618cc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d1d5287-dc50-4416-8e04-5f6cc47747ea', 'attached_at': '', 'detached_at': '', 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'serial': '154572d8-867e-4056-bf4e-d87fcb2cacd8'}, 'volume_type': None}, {'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 2, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'd1711f98-ec19-49b3-b28d-9acd3fe2b965', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '1d1d5287-dc50-4416-8e04-5f6cc47747ea', 'attached_at': '', 'detached_at': '', 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'serial': '9fac7c50-4cb1-491c-b359-35726050ee98'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:16.449996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:16.450145 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:16.458459 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:16.460881 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-538963615', uuid='1d1d5287-dc50-4416-8e04-5f6cc47747ea'), owner=OwnerMeta(userid='37820297b6154d5cab2a158004754721', username='tempest-TaggedBootDevicesTest_v242-15632634-project-member', projectid='ba1a070782e1452690c54eb9a95cb8d3', projectname='tempest-TaggedBootDevicesTest_v242-15632634'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771736.459577) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:16.462720 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:16.463285 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:16.464698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:16.465036 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:16.468439 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:16.468904 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:16.468904 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:16.470256 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:16.470256 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:16.470256 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:16.473398 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:16.475416 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:16.475983 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:16.475983 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:16.475983 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:16.476210 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:16.502849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:16.503145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:16.504126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:16.505176 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:16.507094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:16.517278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:16.527958 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:16.528229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:16.529051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:16.529782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:16.532778 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] No waiting events found dispatching network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:16.533719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5c54f5a2-79ff-4e16-b606-19c251b5a4ba req-51e27b75-4aa9-42a5-b305-df222f28fe42 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:02:16.536575 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:16.539619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:16.539619 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:16.541277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:16.541958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:16.542075 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:16.565411 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:16.565411 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:16.572062 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Instance destroyed successfully.
May 26 05:02:16.579568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:16.579568 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:16.580697 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lazy-loading 'resources' on Instance uuid b376e915-7cc0-44a9-b4ea-f9921835db8f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:16.591292 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:16.595650 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9] added
May 26 05:02:16.595650 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:16.595650 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:16.595650 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:16.595650 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:16.595650 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:16.595650 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:16.596008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:16.596008 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0567(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:16.596401 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9] added
May 26 05:02:16.604287 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:16.604287 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0613(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:16.604287 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:16.626191 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Took 9.94 seconds to spawn the instance on the hypervisor.
May 26 05:02:16.626656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:16.747657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:16.815783 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Creating config drive at /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config
May 26 05:02:16.822597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbatk5g__ {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:16.874044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpbatk5g__" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:16.905899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:16.917604 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:16.957516 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:17.023066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:17.024131 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'flavor' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:17.029530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:17.031311 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:17.086446 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-95886711',display_name='tempest-VolumesActionsTest-instance-95886711',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-95886711',id=22,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:12Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e6f813ccf14854b9ea9a5a58629736',ramdisk_id='',reservation_id='r-8ozydyrv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-320780185',owner_user_name='tempest-VolumesActionsTest-320780185-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:13Z,user_data=None,user_id='f55e5be56ba5425eab028cfc593a866f',uuid=b376e915-7cc0-44a9-b4ea-f9921835db8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:02:17.086749 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converting VIF {"id": "416ceb1f-c598-4997-a912-b80aaab260d1", "address": "fa:16:3e:a2:90:9e", "network": {"id": "4adfb427-10d9-400e-b6f6-ae275de737ad", "bridge": "br-int", "label": "tempest-VolumesActionsTest-285958098-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "90e6f813ccf14854b9ea9a5a58629736", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap416ceb1f-c5", "ovs_interfaceid": "416ceb1f-c598-4997-a912-b80aaab260d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:17.087956 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:17.087956 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:02:17.094708 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.095081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap416ceb1f-c5, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:17.099560 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.100736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:17.111793 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.115539 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.115815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e74c77cc-a010-453f-b2b7-aba002454cb2) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:17.116449 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.117070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:17.130820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.137410 np0000001388 nova-compute[98319]: INFO os_vif [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:90:9e,bridge_name='br-int',has_traffic_filtering=True,id=416ceb1f-c598-4997-a912-b80aaab260d1,network=Network(4adfb427-10d9-400e-b6f6-ae275de737ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap416ceb1f-c5')
May 26 05:02:17.137410 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Deleting instance files /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f_del
May 26 05:02:17.137410 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Deletion of /opt/stack/data/nova/instances/b376e915-7cc0-44a9-b4ea-f9921835db8f_del complete
May 26 05:02:17.148152 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Took 19.49 seconds to build instance.
May 26 05:02:17.174184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:17.174770 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:17.227907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:17.228115 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:17.228326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] No VIF found with MAC fa:16:3e:1b:75:ad, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:17.228926 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Using config drive
May 26 05:02:17.405676 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:17.419613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.426399 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771737.4232643, 71b40a96-611b-4143-a895-e464b0ce391d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:17.426399 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] VM Paused (Lifecycle Event)
May 26 05:02:17.464370 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.467396 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.542996 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:17.545303 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.596769 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:17.598042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.600595 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.604325 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:17.615378 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:17.615378 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:17.626982 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:17.626982 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.630019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:17.643607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.646394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.654512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.010s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:17.655119 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Took 1.49 seconds to destroy the instance on the hypervisor.
May 26 05:02:17.656312 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:02:17.660020 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:02:17.660020 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:02:17.660020 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.662169 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.663110 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.670943 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.672304 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:17.680346 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:17.704412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.40.100,3260]
May 26 05:02:17.704412 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.40.100,3260] successful.
May 26 05:02:17.704412 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.723117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.725752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.50.100,3260]
May 26 05:02:17.725752 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.50.100,3260] successful.
May 26 05:02:17.725752 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.738096 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.744497 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.205s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:17.744497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:17.745720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('7', '-', '-', 0) found on session 47 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:17.745856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:17.753212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:17.777921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 47 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:17.777921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.782818 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:17.789009 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:17.789540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.248s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:17.789732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:17.791638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('14', '-', '-', 0) found on session 48 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:17.791883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:17.816506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 48 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:17.816720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:17.873707 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updated VIF entry in instance network info cache for port e945b3df-400c-4c78-a398-1e41795b4479. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:17.874096 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:17.938442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:17.980437 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771737.9788153, 71b40a96-611b-4143-a895-e464b0ce391d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:17.980437 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] VM Resumed (Lifecycle Event)
May 26 05:02:18.005583 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.027011 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.044023 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance destroyed successfully.
May 26 05:02:18.045465 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'numa_topology' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:18.070720 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.092867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.142233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:18.195625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.856s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:18.195625 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Migrating
May 26 05:02:18.196256 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:02:18.212663 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Creating config drive at /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/disk.config
May 26 05:02:18.237590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiqnhw8an {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:18.253495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.291375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5a389b-6dc2-4ed2-a535-ae3fd040a8d2 req-a6ced9a0-45a0-47f6-8542-0268fa06a2e8 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:18.291645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5a389b-6dc2-4ed2-a535-ae3fd040a8d2 req-a6ced9a0-45a0-47f6-8542-0268fa06a2e8 service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:18.293783 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:18.297888 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5a389b-6dc2-4ed2-a535-ae3fd040a8d2 req-a6ced9a0-45a0-47f6-8542-0268fa06a2e8 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:18.298166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5a389b-6dc2-4ed2-a535-ae3fd040a8d2 req-a6ced9a0-45a0-47f6-8542-0268fa06a2e8 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:18.298361 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5a389b-6dc2-4ed2-a535-ae3fd040a8d2 req-a6ced9a0-45a0-47f6-8542-0268fa06a2e8 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Processing event network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:18.312125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiqnhw8an" returned: 0 in 0.074s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:18.324491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:18.324696 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing instance network info cache due to event network-changed-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:18.324763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Acquiring lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:18.377862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:18.378076 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-changed-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:18.378234 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing instance network info cache due to event network-changed-daeb843a-0159-409b-8390-b08c56ae2515. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:18.378401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquiring lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:18.378492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquired lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:18.378647 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Refreshing network info cache for port daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:18.482776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:18.500626 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:18.544799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:02:18.566041 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Object Instance<e91a9807-3af1-440f-8391-32c1221de940> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:18.667901 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:18.667901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] Acquiring lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:18.668227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:18.668227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:18.669063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] No waiting events found dispatching network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:18.669063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f1be5a97-ab36-42b9-8481-f3998eb7d479 req-acb2f82e-6920-427b-b39d-6d6d8a3d3015 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-unplugged-416ceb1f-c598-4997-a912-b80aaab260d1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:02:18.729497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:18.729497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:18.729708 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:18.735471 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:18.739883 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:18.745648 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:18.756952 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Instance spawned successfully.
May 26 05:02:18.758319 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:18.887874 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:18.894537 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updated VIF entry in instance network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:18.895336 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:18.997700 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999634535000041 future=<Future at 0x7d7aa4295190 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:18.998050 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999205734000043 future=<Future at 0x7d7aa4295190 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:18.998247 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99901323899985 future=<Future at 0x7d7aa4295190 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:18.998688 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99978831899989 future=<Future at 0x7d7aa4296d80 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:18.998906 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771738.9987142, 02578b5c-b022-4d9a-ac22-3552d7e39881 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:18.999055 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] VM Started (Lifecycle Event)
May 26 05:02:19.128548 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.153071 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.153071 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.162455 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:19.234171 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:19.278281 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.282072 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.282072 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.282539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.285254 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.286079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:19.357610 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:19.398233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.407889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c709b1ae-1514-4f7e-a063-887f96062b7f req-f7211986-8b66-45ea-b763-76459b05744c service nova] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:19.408901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Acquired lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:19.410336 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Refreshing network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:19.502442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:19.512561 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:19.556713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.582745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Found WWN 3300000007138490c for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:19.582745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.077s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:19.582745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== connect_volume: return (3079ms) {'type': 'block', 'scsi_wwn': '3300000007138490c', 'path': '/dev/dm-7', 'multipath_id': '3300000007138490c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:19.582920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007138490c', 'path': '/dev/dm-7', 'multipath_id': '3300000007138490c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:19.601153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.664744 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Took 2.01 seconds to deallocate network for instance.
May 26 05:02:19.679428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.713523 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.728467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:19.787743 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updated VIF entry in instance network info cache for port daeb843a-0159-409b-8390-b08c56ae2515. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:19.788043 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updating instance_info_cache with network_info: [{"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:19.799254 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Took 7.51 seconds to spawn the instance on the hypervisor.
May 26 05:02:19.799254 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:19.914450 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:20.019464 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:02:20.019464 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771740.0185986, 02578b5c-b022-4d9a-ac22-3552d7e39881 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:20.019464 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] VM Paused (Lifecycle Event)
May 26 05:02:20.030383 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:20.099934 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:20.101923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:20.101923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:20.206124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.206547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.286084 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:20.290033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:20.292650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Releasing lock "refresh_cache-f40c13f1-a910-4f6a-b000-2baa84ce86fa" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:20.294864 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-changed-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.294864 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Refreshing instance network info cache due to event network-changed-0f10a0b5-86a5-4382-99e5-e170ea108458. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:20.294864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:20.299976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:20.300978 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:20.332596 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Took 16.59 seconds to build instance.
May 26 05:02:20.333843 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:20.441109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.441659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.441659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.442317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.442317 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:20.442317 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received unexpected event network-vif-plugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 for instance with vm_state active and task_state None.
May 26 05:02:20.446225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-changed-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.446225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Refreshing instance network info cache due to event network-changed-e9ada007-95ef-495c-83fe-e5e42726bda7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:20.446225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Acquiring lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:20.446225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Acquired lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:20.446225 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Refreshing network info cache for port e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:20.455626 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.455769 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.455944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.456084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.456419 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:20.456419 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state rescued and task_state unrescuing.
May 26 05:02:20.456497 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.456598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.456720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.456829 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.456935 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Processing event network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:20.457049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.457216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.457403 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.457530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.459278 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] No waiting events found dispatching network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:20.461779 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received unexpected event network-vif-plugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb for instance with vm_state building and task_state spawning.
May 26 05:02:20.461865 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.462074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.462303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.462412 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.462567 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:20.462649 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state rescued and task_state unrescuing.
May 26 05:02:20.462702 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.462860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:20.462999 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:20.463111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.463257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:20.463414 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9d18c843-0007-4cf6-855c-644487af239c req-c6148da5-1577-49b9-880c-380932ee29ab service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-plugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state rescued and task_state unrescuing.
May 26 05:02:20.515539 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:20.522015 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:20.524539 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771740.5242558, 02578b5c-b022-4d9a-ac22-3552d7e39881 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:20.524671 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] VM Resumed (Lifecycle Event)
May 26 05:02:20.764495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3aba38f0-d61f-4a7d-a75d-daa71cdcb0d7 req-c5e118aa-3e93-4550-a135-32693322bc98 service nova] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Received event network-vif-deleted-416ceb1f-c598-4997-a912-b80aaab260d1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:20.795782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:20.796904 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:20.797118 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Refreshing network info cache for port 0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:20.803533 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:20.815418 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:20.818380 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updated VIF entry in instance network info cache for port 99f251d1-253d-4cbe-8b08-c3a4a9ac5f19. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:20.818964 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [{"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:20.831798 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Instance spawned successfully.
May 26 05:02:20.834741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:20.836035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-011bec5f-b972-48f9-b4eb-e2864b4875ba tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.108s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:20.849855 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8fd2387a-6b6f-45a1-93a8-0f218e4327f3 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:20.949759 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:20.969070 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:20.969493 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:21.027912 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:21.032118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:21.309966 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:21.323343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Releasing lock "refresh_cache-e91a9807-3af1-440f-8391-32c1221de940" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:21.323530 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:21.323744 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:21.323947 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:21.324117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:21.324117 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:21.324408 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-31372519-9053-4f84-86ca-ccba973fe962 req-0fcedf77-f9cb-458e-8f43-137f65e62e90 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received unexpected event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with vm_state rescued and task_state unrescuing.
May 26 05:02:21.345793 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.346036 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.346442 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.347836 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.347836 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.351642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:21.371131 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:21.473339 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:21.535427 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771741.5350385, 833f5c94-6742-454b-a72e-75930e6b3aff => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:21.535628 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] VM Started (Lifecycle Event)
May 26 05:02:21.639327 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updated VIF entry in instance network info cache for port e9ada007-95ef-495c-83fe-e5e42726bda7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:21.639327 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating instance_info_cache with network_info: [{"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:21.756334 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:21.841240 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:21.874661 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Took 10.68 seconds to spawn the instance on the hypervisor.
May 26 05:02:21.874893 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:21.979414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.878s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:21.979581 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:21.987358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.781s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:21.995340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:21.996019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:21.996977 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:21.997215 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:21.997755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:21.997958 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:22.014933 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:22.014933 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:22.022919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:22.022919 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:22.038728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8] added
May 26 05:02:22.041675 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:22.041675 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:22.041675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:22.042057 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0447(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:22.043709 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8] added
May 26 05:02:22.045840 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:22.045840 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:22.045840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:22.046254 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0479(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:22.046254 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:22.048273 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:22.070848 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Deleted allocations for instance b376e915-7cc0-44a9-b4ea-f9921835db8f
May 26 05:02:22.077309 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updated VIF entry in instance network info cache for port 0f10a0b5-86a5-4382-99e5-e170ea108458. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:22.078511 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:22.117099 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.141538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a5e50c4-fe50-4e2d-80d6-4b0ebcf44761 req-024b4596-17a5-4d02-aeaa-4144d319c166 service nova] Releasing lock "refresh_cache-71b40a96-611b-4143-a895-e464b0ce391d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:22.331321 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 26 05:02:22.360502 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.365427 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.392458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.404989 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Took 21.22 seconds to build instance.
May 26 05:02:22.552647 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771742.5498562, 833f5c94-6742-454b-a72e-75930e6b3aff => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:22.552647 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] VM Paused (Lifecycle Event)
May 26 05:02:22.585509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-67b5f5c0-5f20-45a0-b1ab-aa0346b3d6b5 req-d5ba474a-5385-4431-8d96-4cd75f1a70d0 service nova] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:22.585764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.597064 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.639229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:22.639229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:22.639416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:22.639879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:22.639879 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:22.640055 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-7092c301-c187-421e-94ce-2e62270fa4d9 req-69d40bd1-5dea-42c7-a295-8acb95bc3798 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received unexpected event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with vm_state active and task_state resize_migrating.
May 26 05:02:22.733544 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance destroyed successfully.
May 26 05:02:22.735499 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:10Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:02:22.735864 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:22.737014 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:22.738575 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:02:22.740269 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.740693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f10a0b5-86, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:22.743088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.744693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:22.745524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.745653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24590e48-1a82-450f-83d5-c91d8e0271b0) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:22.747821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.747821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:22.748898 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:22.754553 np0000001388 nova-compute[98319]: INFO os_vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86')
May 26 05:02:22.757438 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:02:22.757438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:22.757438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:22.856724 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-changed-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:22.856866 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing instance network info cache due to event network-changed-f2a35255-f23f-4276-bb5a-924ea9ba2cc8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:22.857228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:22.857228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:22.857440 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing network info cache for port f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:22.912486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.740s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:23.044178 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:23.046612 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:23.055674 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:23.056942 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:23.056942 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:23.061606 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:23.061606 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.068922 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771743.065264, 833f5c94-6742-454b-a72e-75930e6b3aff => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:23.068922 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] VM Resumed (Lifecycle Event)
May 26 05:02:23.074555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.081090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.088178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bfa1cfb6-8515-4e96-8132-03e26e2cf6bd tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Lock "b376e915-7cc0-44a9-b4ea-f9921835db8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.436s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.094008 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.094420 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.103302 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.103618 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:23.138811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.40.100,3260]
May 26 05:02:23.138811 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.40.100,3260] successful.
May 26 05:02:23.138811 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.154043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.165280 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.50.100,3260]
May 26 05:02:23.165280 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.50.100,3260] successful.
May 26 05:02:23.165280 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.175639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.180254 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.180662 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:23.180935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:23.180935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:23.182023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('16', '-', '-', 0) found on session 50 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:23.182180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 50 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:23.203850 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('17', '-', '-', 0) found on session 51 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:23.203850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:23.230340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 51 and hctl ['17', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:23.361980 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:23.568774 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:23.570272 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:23.808741 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:24.003226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updated VIF entry in instance network info cache for port f2a35255-f23f-4276-bb5a-924ea9ba2cc8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:24.003226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:24.077111 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for e91a9807-3af1-440f-8391-32c1221de940 due to new event <LifecycleEvent: 1779771744.0756497, e91a9807-3af1-440f-8391-32c1221de940 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:02:24.077111 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771744.0756497, e91a9807-3af1-440f-8391-32c1221de940 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:24.077111 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Resumed (Lifecycle Event)
May 26 05:02:24.229686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 51 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:24.229864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:24.431802 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432216 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432317 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432473 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432640 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432949 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.432949 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.433083 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:02:24.433365 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.18 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:02:24.506619 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-14490260-15e5-4482-9393-744528349307 req-af1609ee-30fa-45f8-b3f6-2dd25239c4a5 service nova] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:24.582061 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:24.583776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:24.617866 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:02:24.725886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:24.726068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:24.726251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:24.726378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:24.726503 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:24.726628 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received unexpected event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with vm_state active and task_state resize_migrating.
May 26 05:02:24.726745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:24.726861 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing instance network info cache due to event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:24.726985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:24.727086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:24.727469 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:25.016983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Found WWN 3300000004c1c5633 for multipath device dm-10 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:25.017896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:25.017896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== connect_volume: return (4916ms) {'type': 'block', 'scsi_wwn': '3300000004c1c5633', 'path': '/dev/dm-10', 'multipath_id': '3300000004c1c5633'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:25.018879 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004c1c5633', 'path': '/dev/dm-10', 'multipath_id': '3300000004c1c5633'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:25.021001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.263s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:25.021563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:02:25.021746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:25.061609 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [43] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:25.062177 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '44'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088', '49'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:02:25.062177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '44')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:25.064638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '43')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:25.065982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4441f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:02:25.066280 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:02:25.066732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flush multipath device 3300000001daa20bc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:02:25.088040 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771745.0876284, e91a9807-3af1-440f-8391-32c1221de940 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:25.088951 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Started (Lifecycle Event)
May 26 05:02:25.124528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:25.124528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:25.124528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:25.124528 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:02:25.137605 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:25.138691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing instance network info cache due to event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:25.138858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:25.141603 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:25.202689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:25.231715 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:25.260929 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:02:25.261167 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:02:25.262771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:02:25.288721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:02:25.289424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:02:25.313546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.356735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260]
May 26 05:02:25.356735 np0000001388 nova-compute[98319]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260] successful.
May 26 05:02:25.356735 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.380623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.394785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.433786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260]
May 26 05:02:25.433786 np0000001388 nova-compute[98319]: Logout of [sid: 43, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260] successful.
May 26 05:02:25.433786 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.457412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:25.457690 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:25.457866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== disconnect_volume: return (2700ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:25.458059 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:02:25.460584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:02:25.461058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19_resize/disk.config /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:25.504732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "cp -r /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19_resize/disk.config /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config" returned: 0 in 0.043s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:25.532834 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:25.533441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:25.533677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:25.591620 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:25.599187 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e91a9807-3af1-440f-8391-32c1221de940] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:25.665189 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:25.813630 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updated VIF entry in instance network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:25.813893 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:26.102693 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999638090999724 future=<Future at 0x7d7ae41b2ae0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:26.172671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.262777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.264764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.320876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6b8d4da-5efe-4fc2-bfb1-9616c4993324 req-0ab197be-2756-425a-86f3-807239cef5f7 service nova] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:26.321701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:26.321940 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:26.352847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.357129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.449277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.449933 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.533513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.537937 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:02:26.540021 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.625540 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.626460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.664888 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:26.665738 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:26.729919 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.730457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:02:26.735265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.759103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:26.784023 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Port 0f10a0b5-86a5-4382-99e5-e170ea108458 binding to destination host np0000001388 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 26 05:02:26.829651 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:26.851539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.852138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:26.970617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:26.974413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:02:26.980024 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:26.981402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:27.050380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:27.050513 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13073MB free_disk=74.21342086791992GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:02:27.050762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:27.051080 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:27.216357 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:27.216482 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing instance network info cache due to event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:27.216653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:27.372541 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:27.553633 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updated VIF entry in instance network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:27.554071 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:27.746990 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:27.805116 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:02:27.828529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:27.828685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:27.828817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:28.056518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4792b647-19df-4a6c-a3a5-a36f127d0041 req-135967b1-100a-40ca-94ef-673aa88ee1f7 service nova] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:28.058287 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:28.058287 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:28.066927 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Applying migration context for instance ec4ecad1-7f2e-4026-b3c5-be40769b3a19 as it has an incoming, in-progress migration d7db862c-5526-40d8-abfb-ad55b6554429. Migration status is post-migrating {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}}
May 26 05:02:28.068382 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating resource usage from migration d7db862c-5526-40d8-abfb-ad55b6554429
May 26 05:02:28.146976 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f40c13f1-a910-4f6a-b000-2baa84ce86fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.147131 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e91a9807-3af1-440f-8391-32c1221de940 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.147293 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.147425 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 71b40a96-611b-4143-a895-e464b0ce391d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.148261 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 833f5c94-6742-454b-a72e-75930e6b3aff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.148261 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 02578b5c-b022-4d9a-ac22-3552d7e39881 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.148261 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Migration d7db862c-5526-40d8-abfb-ad55b6554429 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 26 05:02:28.148261 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance ec4ecad1-7f2e-4026-b3c5-be40769b3a19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:02:28.148261 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:02:28.148862 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2112MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:02:27 up 34 min,  2 users,  load average: 8.69, 6.49, 3.22\n', 'num_instances': '7', 'num_vm_active': '6', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_278ea77812db4e90a14904f104739285': '2', 'io_workload': '2', 'num_proj_07c7eafe2c8f4d5bac4c03e3968605a2': '1', 'num_task_resize_migrating': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_ba1a070782e1452690c54eb9a95cb8d3': '1', 'num_proj_c32d47b7a83249e09dab2cfa30367843': '1', 'num_proj_fa36a5abcae34ede974ef08e44316802': '1', 'num_proj_6947ca5ef3684f329c6584405e98f535': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:02:28.563045 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:28.602120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.068s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:28.602521 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:28.618282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:28.619379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:28.619652 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:28.620522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:28.621949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:28.622418 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:28.638692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:28.638692 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:28.645682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:28.645682 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:28.658658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98] added
May 26 05:02:28.658658 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:28.658658 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:28.658658 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:28.658658 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:28.658658 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:28.658658 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:28.659036 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:28.659186 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:28.660177 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:28.663307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98] added
May 26 05:02:28.663307 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:28.663307 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:28.663307 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:28.663307 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:28.663307 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:28.663307 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:28.663578 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:28.664424 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:28.664424 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:28.692680 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:28.693071 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:28.837435 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:29.020227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:29.021247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:29.021404 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:29.066272 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:29.196402 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:29.268546 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updated VIF entry in instance network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:29.268883 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:29.524861 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:29.659958 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:29.665329 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:29.688207 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:29.688207 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.704848 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:02:29.704848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.654s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:29.705160 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 56.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:29.709038 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:29.709038 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.715838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.739079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.745293 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.762634 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.763427 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:29.775174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-06c3d57c-9485-40ec-b247-3de5e225eb5e req-ec1df9f0-d9d6-4ae4-93cb-e3a173e653f4 service nova] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:29.820526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.40.100,3260]
May 26 05:02:29.820526 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.40.100,3260] successful.
May 26 05:02:29.820526 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.830431 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.50.100,3260]
May 26 05:02:29.830431 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.50.100,3260] successful.
May 26 05:02:29.830431 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.836028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.845590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.859813 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.861738 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.242s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:29.861738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:29.868470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('18', '-', '-', 0) found on session 54 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:29.868470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:29.879355 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.256s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] HCTL ('19', '-', '-', 0) found on session 55 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:29.879355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:29.896827 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 54 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:29.896827 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:29.908483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Searching for a device in session 55 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:29.908483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:30.009063 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:30.208502 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:30.629849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:02:30.710819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:31.243502 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:31.276623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:02:31.325573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:31.392276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:02:31.392635 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:02:31.402783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:02:31.405223 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fefc:c9eb', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fe68:cb88', 'fe80::2c0b:61ff:feff:8ac3', 'fe80::fc16:3eff:fe1b:75ad', 'fe80::7cfe:65ff:fe02:3134', 'fe80::fc16:3eff:fed2:7767', 'fe80::4c87:b6ff:feb1:cd9f'] 
May 26 05:02:31.405223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:02:31.405223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:02:31.405223 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:31.663452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Found WWN 3300000003b14a1fc for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:31.664115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.062s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:31.664479 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== connect_volume: return (6130ms) {'type': 'block', 'scsi_wwn': '3300000003b14a1fc', 'path': '/dev/dm-2', 'multipath_id': '3300000003b14a1fc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:31.667866 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b14a1fc', 'path': '/dev/dm-2', 'multipath_id': '3300000003b14a1fc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:31.759772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.183444 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.183444 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.185073 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.186940 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.186940 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.187831 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.189166 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.190154 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.191179 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.192136 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.192136 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.193256 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.194256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.194879 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.197062 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.198157 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.198481 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.201721 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.201721 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:32.201721 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.201721 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.202276 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d1d5287-dc50-4416-8e04-5f6cc47747ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:32.668222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 26 05:02:32.668222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:02:32.668222 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Creating image(s)
May 26 05:02:32.668222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:02:32.668222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Ensure instance console log exists: /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:02:32.668748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.669078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.669309 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.670123 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start _get_guest_xml network_info=[{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'b1db49cc-738d-4bdd-9643-cbc2af3eae63', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'ec4ecad1-7f2e-4026-b3c5-be40769b3a19', 'attached_at': '2026-05-26T05:02:32.000000', 'detached_at': '', 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'serial': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:02:32.675878 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:02:32.677401 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherA-server-696737626', uuid='ec4ecad1-7f2e-4026-b3c5-be40769b3a19'), owner=OwnerMeta(userid='e78b48c4b4dc439086e392b4800b4ad7', username='tempest-ServerActionsTestOtherA-846952046-project-member', projectid='278ea77812db4e90a14904f104739285', projectname='tempest-ServerActionsTestOtherA-846952046'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771752.6770291) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:02:32.678480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:02:32.678880 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:02:32.679893 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:02:32.680153 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:02:32.680991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:02:32.681365 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:02:32.681603 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:02:32.681759 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:02:32.681949 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:02:32.682115 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:02:32.682301 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:02:32.682513 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:02:32.682779 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:02:32.682952 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:02:32.683126 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:02:32.683378 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:02:32.694446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:32.712895 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <uuid>1d1d5287-dc50-4416-8e04-5f6cc47747ea</uuid>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <name>instance-00000015</name>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:name>tempest-device-tagging-server-538963615</nova:name>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:16</nova:creationTime>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:user uuid="37820297b6154d5cab2a158004754721">tempest-TaggedBootDevicesTest_v242-15632634-project-member</nova:user>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:project uuid="ba1a070782e1452690c54eb9a95cb8d3">tempest-TaggedBootDevicesTest_v242-15632634</nova:project>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="a183d9a1-bb48-426b-8663-8113a1e6df94">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="bfe036f8-08bb-4b85-b78e-28e8b76d4ff5">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="ab88d52b-7850-42b4-9af0-733bf16b3461">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.61" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="ba67c92e-9ff7-41fa-9a12-c8043357b83b">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.85" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="e93d6144-2bb7-4826-b780-4de24fb838f7">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.1.5" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="76837440-e063-400b-9639-ffafb76b64bd">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         <nova:port uuid="e945b3df-400c-4c78-a398-1e41795b4479">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="serial">1d1d5287-dc50-4416-8e04-5f6cc47747ea</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="uuid">1d1d5287-dc50-4416-8e04-5f6cc47747ea</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/disk.config"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <alias name="ua-7ec8dd0f-0f02-43c8-9519-11307e31b4b9"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <serial>7ec8dd0f-0f02-43c8-9519-11307e31b4b9</serial>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <alias name="ua-154572d8-867e-4056-bf4e-d87fcb2cacd8"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-10"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <serial>154572d8-867e-4056-bf4e-d87fcb2cacd8</serial>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <alias name="ua-9fac7c50-4cb1-491c-b359-35726050ee98"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <serial>9fac7c50-4cb1-491c-b359-35726050ee98</serial>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b3:ab:41"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tapa183d9a1-bb"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:dc:6e:53"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tapbfe036f8-08"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:cf:df:18"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tapab88d52b-78"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ec:3f:86"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tapba67c92e-9f"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:90:9b:7d"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tape93d6144-2b"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:57:42:de"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tap76837440-e0"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:91:6a:9c"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <target dev="tape945b3df-40"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/console.log" append="off"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:32.712895 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.717552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.718031 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.718031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.718031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.718031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.718177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.718232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.718410 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.718473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.718614 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.718687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.718835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.718905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.719053 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Preparing to wait for external event network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:02:32.719147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.720289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.720587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.722654 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:32.722654 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.723445 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.724572 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:32.726425 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.727074 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.728111 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:32.730585 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.731417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e502023b-484b-528d-84e9-ac201ce9c1ad', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.742987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.744049 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.751345 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.751557 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa183d9a1-bb, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.752052 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa183d9a1-bb, col_values=(('qos', UUID('e571c446-f421-46b4-8b44-074e3eeafa9a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.752401 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa183d9a1-bb, col_values=(('external_ids', {'iface-id': 'a183d9a1-bb48-426b-8663-8113a1e6df94', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:ab:41', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.753666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.755285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.761701 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.764290 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb')
May 26 05:02:32.764290 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:32.764290 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.764290 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.764290 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:32.764821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.764873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.765101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:32.765897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.766020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f89e786-c23c-57bc-9735-a78b1f4470ae', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.766858 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.769239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.773598 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.777420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.777816 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfe036f8-08, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.778424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfe036f8-08, col_values=(('qos', UUID('5681e837-febf-4631-af65-eeba73fa0b9a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.778424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfe036f8-08, col_values=(('external_ids', {'iface-id': 'bfe036f8-08bb-4b85-b78e-28e8b76d4ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:6e:53', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.780996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.782795 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.796333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.800745 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08')
May 26 05:02:32.800745 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:32.800745 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.800745 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.800745 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:32.801338 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.801496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.801776 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:32.802660 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.802884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '095077d8-4c74-5fe6-9c47-89dbed0f295b', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.804736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.805306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.806961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:32.807725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:32.808100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:32.808932 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:32.809514 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:02:32.810338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:32.810737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:32.811465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:32.811649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:02:32.819071 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.821846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.822376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab88d52b-78, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.822692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab88d52b-78, col_values=(('qos', UUID('26c5fdc7-7133-4c91-9e93-5f3cc4ee56bc')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.822860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab88d52b-78, col_values=(('external_ids', {'iface-id': 'ab88d52b-7850-42b4-9af0-733bf16b3461', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:df:18', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.827944 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.833323 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:32.834161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:32.835076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:32.835778 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:32.837033 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:32.837171 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:32.848702 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.848702 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78')
May 26 05:02:32.848702 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:32.848702 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.850691 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.850691 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:32.850691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.850691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.850691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:32.853524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.853524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b9b6be6-06d4-567d-a132-4c801cc2d1f8', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.854821 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:32.854821 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:32.858736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.865690 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:02:32.865690 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:32.872998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f] added
May 26 05:02:32.872998 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:32.872998 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:32.872998 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:32.872998 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:32.872998 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:32.872998 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:32.873391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:32.873435 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:32.873598 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:32.886230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f] added
May 26 05:02:32.886230 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:02:32.886230 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:32.886230 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:32.886230 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:02:32.886230 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:02:32.886230 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:32.886567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:02:32.889427 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0514(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:02:32.890976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.891858 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:02:32.897273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.897566 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba67c92e-9f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.898354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba67c92e-9f, col_values=(('qos', UUID('9d4c1f07-83e1-429f-91ed-b2dce22441dd')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.898354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba67c92e-9f, col_values=(('external_ids', {'iface-id': 'ba67c92e-9ff7-41fa-9a12-c8043357b83b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:3f:86', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.901063 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.905037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.942875 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.945173 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f')
May 26 05:02:32.950530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:32.950831 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:32.951391 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:32.951611 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:32.952133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.952347 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.952539 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:32.955868 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.955868 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f69dc3c-2fc0-5e43-8243-6343229dc7a0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:32.955868 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.959227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:32.991755 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:32.999862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.000231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape93d6144-2b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.000680 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape93d6144-2b, col_values=(('qos', UUID('dd3434dc-838a-49bd-9b39-f735e92b478d')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.000900 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape93d6144-2b, col_values=(('external_ids', {'iface-id': 'e93d6144-2bb7-4826-b780-4de24fb838f7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:9b:7d', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.003283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.005458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:33.042357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.045366 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b')
May 26 05:02:33.047067 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:33.047324 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:33.048399 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:33.048610 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:33.050708 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.051082 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.051357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:33.054366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.054593 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89113768-9068-5e28-af25-4a79ac8d9672', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.059394 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.059394 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:33.093416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.098236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.098236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76837440-e0, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.098236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76837440-e0, col_values=(('qos', UUID('4e66018e-f108-4c7a-a336-25a0ff43cb52')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.098453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76837440-e0, col_values=(('external_ids', {'iface-id': '76837440-e063-400b-9639-ffafb76b64bd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:42:de', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.101704 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.104803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:33.151860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.154209 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0')
May 26 05:02:33.157223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:33.157223 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:33.158569 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:33.158569 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:33.159432 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.159693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.159915 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:33.162231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.162517 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '439f142f-14f1-589a-ae17-e83c7bd8a17f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.167605 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:33.204401 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.209665 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.209665 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape945b3df-40, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.210102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape945b3df-40, col_values=(('qos', UUID('054c7b9a-e8de-4e16-be34-61c3123c053c')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.210175 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape945b3df-40, col_values=(('external_ids', {'iface-id': 'e945b3df-400c-4c78-a398-1e41795b4479', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:6a:9c', 'vm-uuid': '1d1d5287-dc50-4416-8e04-5f6cc47747ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:33.212346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.214146 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:33.266210 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:33.269537 np0000001388 nova-compute[98319]: INFO os_vif [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40')
May 26 05:02:33.875630 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:02:33.895233 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:33.905653 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:33.905653 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:02:33.916338 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:02:33.916338 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:33.925408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:33.939762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.966928 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.976818 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:33.977659 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:33.999761 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0024741739998717094 future=<Future at 0x7d7aa4295190 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000097 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000097 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0016156400001818838 future=<Future at 0x7d7aa4296d80 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000248 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0017224270000042452 future=<Future at 0x7d7aa4296d80 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000248 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000359 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.101918122999905 future=<Future at 0x7d7ae41b2ae0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000416 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.101835049999863 future=<Future at 0x7d7ae41b2ae0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:34.000933 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Emitting event <LifecycleEvent: 1779771738.997157, b376e915-7cc0-44a9-b4ea-f9921835db8f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:34.001109 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] VM Stopped (Lifecycle Event)
May 26 05:02:34.068230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260]
May 26 05:02:34.068230 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260] successful.
May 26 05:02:34.068230 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:34.085776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,0 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:34.116543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:34.117537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.280s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:34.117537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:34.118771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('20', '-', '-', 0) found on session 56 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:34.118903 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:34.153465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 56 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:34.153715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:34.510743 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-886d2533-b71f-4405-ae33-5ce4e0c92246 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: b376e915-7cc0-44a9-b4ea-f9921835db8f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:34.828306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:34.828626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:34.828888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] No VIF found with MAC fa:16:3e:b3:ab:41, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:34.829100 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] No VIF found with MAC fa:16:3e:90:9b:7d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:34.829758 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Using config drive
May 26 05:02:35.065705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260]
May 26 05:02:35.065705 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260] successful.
May 26 05:02:35.065705 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:35.088025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:35.127112 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [49] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [52] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [53] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b2e08a96-0730-41fd-89b1-61de12fbb2e7 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:35.127666 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.293s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:35.127666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:02:35.129126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] HCTL ('21', '-', '-', 0) found on session 57 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:02:35.129738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:02:35.153937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Searching for a device in session 57 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:02:35.154545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:02:35.348730 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:35.617474 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Creating config drive at /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/disk.config
May 26 05:02:35.623755 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp626ypcnl {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:02:35.703788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp626ypcnl" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:02:35.872692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Found WWN 3300000001daa20bc for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:02:35.873297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.062s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:35.873518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== connect_volume: return (3062ms) {'type': 'block', 'scsi_wwn': '3300000001daa20bc', 'path': '/dev/dm-3', 'multipath_id': '3300000001daa20bc'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:35.873582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001daa20bc', 'path': '/dev/dm-3', 'multipath_id': '3300000001daa20bc'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:02:36.344747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.401453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:10Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:02:36.401453 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:36.404985 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:36.406257 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] End _get_guest_xml xml=<domain type="qemu">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <uuid>ec4ecad1-7f2e-4026-b3c5-be40769b3a19</uuid>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <name>instance-00000014</name>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <memory>262144</memory>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsTestOtherA-server-696737626</nova:name>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:02:32</nova:creationTime>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:user uuid="e78b48c4b4dc439086e392b4800b4ad7">tempest-ServerActionsTestOtherA-846952046-project-member</nova:user>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:project uuid="278ea77812db4e90a14904f104739285">tempest-ServerActionsTestOtherA-846952046</nova:project>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         <nova:port uuid="0f10a0b5-86a5-4382-99e5-e170ea108458">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.11" ipVersion="4"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <system>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="serial">ec4ecad1-7f2e-4026-b3c5-be40769b3a19</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="uuid">ec4ecad1-7f2e-4026-b3c5-be40769b3a19</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </system>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <os>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </os>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <features>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </features>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   <devices>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <alias name="ua-5af35d79-38f2-4c5a-bfc7-61d05f88f05f"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <serial>5af35d79-38f2-4c5a-bfc7-61d05f88f05f</serial>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </disk>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:9a:19:9a"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <target dev="tap0f10a0b5-86"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </interface>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/console.log" append="off"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </serial>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <video>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </video>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </rng>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:   </devices>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]: </domain>
May 26 05:02:36.406257 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:02:36.418021 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:10Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:02:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:02:36.424973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.428755 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-668956757-network", "vif_mac": "fa:16:3e:9a:19:9a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:36.430110 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:36.430591 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:02:36.432138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:36.432285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:02:36.439047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.439047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e60c815e-c8d1-55bf-954b-8e60ff3372bc', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:36.444934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.448071 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:36.478227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.486438 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.486983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f10a0b5-86, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:36.487810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f10a0b5-86, col_values=(('qos', UUID('578e5b61-30eb-42ff-923a-f7014bb4f46e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:36.487810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f10a0b5-86, col_values=(('external_ids', {'iface-id': '0f10a0b5-86a5-4382-99e5-e170ea108458', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:19:9a', 'vm-uuid': 'ec4ecad1-7f2e-4026-b3c5-be40769b3a19'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:36.495594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.495594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:36.658800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.662263 np0000001388 nova-compute[98319]: INFO os_vif [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86')
May 26 05:02:36.703272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.782544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.788810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:36.790934 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e842ed06-de0d-4b98-9aa7-a71b2c60a8a2 req-ed8ab2e1-220c-469d-b87c-0d1e2477e91c service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:36.792474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e842ed06-de0d-4b98-9aa7-a71b2c60a8a2 req-ed8ab2e1-220c-469d-b87c-0d1e2477e91c service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:36.792474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e842ed06-de0d-4b98-9aa7-a71b2c60a8a2 req-ed8ab2e1-220c-469d-b87c-0d1e2477e91c service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:36.792474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e842ed06-de0d-4b98-9aa7-a71b2c60a8a2 req-ed8ab2e1-220c-469d-b87c-0d1e2477e91c service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:36.792474 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e842ed06-de0d-4b98-9aa7-a71b2c60a8a2 req-ed8ab2e1-220c-469d-b87c-0d1e2477e91c service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:36.939719 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.004530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.027505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.094247 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.128183 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.140477 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.187575 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.199630 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-82b4d9af-b3e6-40f7-b13d-9fb6ea57147d req-ba57c434-b328-4ff6-ac3a-bbb67423c5c9 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:37.199630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82b4d9af-b3e6-40f7-b13d-9fb6ea57147d req-ba57c434-b328-4ff6-ac3a-bbb67423c5c9 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:37.199630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82b4d9af-b3e6-40f7-b13d-9fb6ea57147d req-ba57c434-b328-4ff6-ac3a-bbb67423c5c9 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:37.199630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82b4d9af-b3e6-40f7-b13d-9fb6ea57147d req-ba57c434-b328-4ff6-ac3a-bbb67423c5c9 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:37.199630 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-82b4d9af-b3e6-40f7-b13d-9fb6ea57147d req-ba57c434-b328-4ff6-ac3a-bbb67423c5c9 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:37.237223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.338030 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.438910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.444536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.542992 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.557964 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.610350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.750876 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:37.821025 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2c6643c2-34cd-46ab-acd3-37c648c3af82 req-26110142-7164-4e12-8562-dd98dd43df43 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:37.821305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c6643c2-34cd-46ab-acd3-37c648c3af82 req-26110142-7164-4e12-8562-dd98dd43df43 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:37.821500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c6643c2-34cd-46ab-acd3-37c648c3af82 req-26110142-7164-4e12-8562-dd98dd43df43 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:37.821609 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2c6643c2-34cd-46ab-acd3-37c648c3af82 req-26110142-7164-4e12-8562-dd98dd43df43 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:37.821783 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2c6643c2-34cd-46ab-acd3-37c648c3af82 req-26110142-7164-4e12-8562-dd98dd43df43 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:37.999188 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.007304 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.011239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.051389 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.066464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.202626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:38.205216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:02:38.205216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] No VIF found with MAC fa:16:3e:9a:19:9a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:02:38.205216 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Using config drive
May 26 05:02:38.483563 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.492216 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.824338 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.833871 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.907190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:38.943629 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.015539 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.018591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.019955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No event matching network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 in dict_keys([('network-vif-plugged', 'ab88d52b-7850-42b4-9af0-733bf16b3461'), ('network-vif-plugged', 'ba67c92e-9ff7-41fa-9a12-c8043357b83b'), ('network-vif-plugged', 'e93d6144-2bb7-4826-b780-4de24fb838f7'), ('network-vif-plugged', 'e945b3df-400c-4c78-a398-1e41795b4479')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-a183d9a1-bb48-426b-8663-8113a1e6df94 for instance with vm_state building and task_state spawning.
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.022446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.023036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.023295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:39.024135 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.024135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.024347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.025116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.025116 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No event matching network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 in dict_keys([('network-vif-plugged', 'ba67c92e-9ff7-41fa-9a12-c8043357b83b'), ('network-vif-plugged', 'e93d6144-2bb7-4826-b780-4de24fb838f7'), ('network-vif-plugged', 'e945b3df-400c-4c78-a398-1e41795b4479')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:02:39.025310 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-ab88d52b-7850-42b4-9af0-733bf16b3461 for instance with vm_state building and task_state spawning.
May 26 05:02:39.025429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.025605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.025770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.025917 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.027142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No event matching network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b in dict_keys([('network-vif-plugged', 'e93d6144-2bb7-4826-b780-4de24fb838f7'), ('network-vif-plugged', 'e945b3df-400c-4c78-a398-1e41795b4479')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:02:39.028028 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8fd60180-0237-430d-a48d-273c8800e90f req-7f276010-76ae-451a-8c00-0f29b2b2f002 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b for instance with vm_state building and task_state spawning.
May 26 05:02:39.087074 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.129005 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771759.128518, 1d1d5287-dc50-4416-8e04-5f6cc47747ea => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:39.129870 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] VM Started (Lifecycle Event)
May 26 05:02:39.158673 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.162374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.364439 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No event matching network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 in dict_keys([('network-vif-plugged', 'e93d6144-2bb7-4826-b780-4de24fb838f7'), ('network-vif-plugged', 'e945b3df-400c-4c78-a398-1e41795b4479')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 for instance with vm_state building and task_state spawning.
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.370631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.371168 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No event matching network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 in dict_keys([('network-vif-plugged', 'e945b3df-400c-4c78-a398-1e41795b4479')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:02:39.372580 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-e93d6144-2bb7-4826-b780-4de24fb838f7 for instance with vm_state building and task_state spawning.
May 26 05:02:39.372811 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.374840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.378329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.378590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.380838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Processing event network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:02:39.380838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.380838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:39.381317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.381568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.381696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.382380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:39.382380 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9908d4f3-221a-4c98-a7a7-bc809bc50a22 req-c5d6e75e-c3da-43e2-b202-c72639336c2f service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-e945b3df-400c-4c78-a398-1e41795b4479 for instance with vm_state building and task_state spawning.
May 26 05:02:39.389365 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:02:39.392632 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance spawned successfully.
May 26 05:02:39.395235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:02:39.633616 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:39.638045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:39.723700 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.725312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.733152 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.764100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.768272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:39.908833 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.909029 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.909390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.909643 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.909960 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.910220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:02:39.979262 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.981632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.981964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.982117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.983392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:39.983795 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received unexpected event network-vif-plugged-76837440-e063-400b-9639-ffafb76b64bd for instance with vm_state building and task_state spawning.
May 26 05:02:39.983940 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.984518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.984518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.984518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.984821 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:39.985652 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received unexpected event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with vm_state active and task_state resize_finish.
May 26 05:02:39.985652 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:39.985811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:39.986451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:39.986553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:39.986740 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:39.986852 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-617e4c65-1ac8-4f16-a98b-7d6a553d79dc req-29681b6d-a562-4d3f-93fe-7cb2bc46eaeb service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received unexpected event network-vif-plugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with vm_state active and task_state resize_finish.
May 26 05:02:40.139480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:40.141358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:40.145117 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:02:40.145824 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771760.1452074, 1d1d5287-dc50-4416-8e04-5f6cc47747ea => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:40.145824 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] VM Paused (Lifecycle Event)
May 26 05:02:40.337447 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:02:40.339595 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance running successfully.
May 26 05:02:40.340624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 26 05:02:40.340823 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4b9ccfbd-80db-4ec0-8f5a-165023503cb0 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 26 05:02:40.429946 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Took 32.60 seconds to spawn the instance on the hypervisor.
May 26 05:02:40.430216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:40.451024 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:40.648446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:40.653065 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771760.651655, 1d1d5287-dc50-4416-8e04-5f6cc47747ea => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:40.653065 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] VM Resumed (Lifecycle Event)
May 26 05:02:40.987727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Took 44.69 seconds to build instance.
May 26 05:02:41.103399 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0009616649999770743 future=<Future at 0x7d7ae41b2ae0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:41.103945 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] Emitting event <LifecycleEvent: 1779771746.1021833, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:41.103945 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:41.103945 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Stopped (Lifecycle Event)
May 26 05:02:41.156626 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:41.160657 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:41.490773 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:41.495697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 46.213s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:41.610223 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-24df90bc-2f65-43ef-96b9-86083c591614 tempest-VolumesAdminNegativeTest-951149478 tempest-VolumesAdminNegativeTest-951149478-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:41.664312 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771761.662789, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:41.664312 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Resumed (Lifecycle Event)
May 26 05:02:41.822400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:42.166489 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:42.175146 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:42.638829 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:42.639010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:42.639063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Going to confirm migration 2 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 26 05:02:42.684118 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771762.6837926, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:02:42.684819 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Started (Lifecycle Event)
May 26 05:02:43.148797 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:43.190084 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-changed-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:43.190298 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing instance network info cache due to event network-changed-a183d9a1-bb48-426b-8663-8113a1e6df94. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:43.190395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] Acquiring lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:43.190524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] Acquired lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:43.190677 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Refreshing network info cache for port a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:43.192687 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:02:43.196708 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:02:43.223356 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:43.223785 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:43.224000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquired lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:43.224216 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:02:43.224459 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'info_cache' on Instance uuid ec4ecad1-7f2e-4026-b3c5-be40769b3a19 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:43.694320 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:44.053096 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:44.224662 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updated VIF entry in instance network info cache for port a183d9a1-bb48-426b-8663-8113a1e6df94. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:44.225588 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:44.236696 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:44.682133 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:44.728764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81693c45-bc95-4b5f-9d5d-96d91c0d1758 req-20c5db6f-a7d9-4dd3-80be-c64362e2b202 service nova] Releasing lock "refresh_cache-1d1d5287-dc50-4416-8e04-5f6cc47747ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:44.885115 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [{"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:45.387865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Releasing lock "refresh_cache-ec4ecad1-7f2e-4026-b3c5-be40769b3a19" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:45.388095 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'migration_context' on Instance uuid ec4ecad1-7f2e-4026-b3c5-be40769b3a19 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:45.891599 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Object Instance<ec4ecad1-7f2e-4026-b3c5-be40769b3a19> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:02:45.892430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:45.892601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:46.492784 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:46.829001 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:46.920064 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:02:46.920578 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:02:47.424536 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:02:48.442580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.550s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:49.116121 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Deleted allocation for migration d7db862c-5526-40d8-abfb-ad55b6554429
May 26 05:02:49.187724 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-15e8d6c3-c96a-4a73-b57d-7090783a3381 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Get console output
May 26 05:02:49.286833 np0000001388 nova-compute[98319]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 26 05:02:49.622277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d5b7bb1-ab5d-4118-8bf1-e4d13fced228 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.983s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:51.494214 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:51.832310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:55.069624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:55.070240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:55.572824 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Detaching volume 679d5805-0f4b-4723-a37c-a22d58f43594
May 26 05:02:55.691030 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Attempting to driver detach volume 679d5805-0f4b-4723-a37c-a22d58f43594 from mountpoint /dev/vdb
May 26 05:02:55.695167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Found disk vdb by alias ua-679d5805-0f4b-4723-a37c-a22d58f43594 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:02:55.696343 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Found disk vdb by alias ua-679d5805-0f4b-4723-a37c-a22d58f43594 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:02:55.696500 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Attempting to detach device vdb from instance e91a9807-3af1-440f-8391-32c1221de940 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:02:55.696773 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <alias name="ua-679d5805-0f4b-4723-a37c-a22d58f43594"/>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <serial>679d5805-0f4b-4723-a37c-a22d58f43594</serial>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]: </disk>
May 26 05:02:55.696773 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:02:55.707112 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Successfully detached device vdb from instance e91a9807-3af1-440f-8391-32c1221de940 from the persistent domain config.
May 26 05:02:55.707305 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] (1/8): Attempting to detach device vdb with device alias ua-679d5805-0f4b-4723-a37c-a22d58f43594 from instance e91a9807-3af1-440f-8391-32c1221de940 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:02:55.707546 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <alias name="ua-679d5805-0f4b-4723-a37c-a22d58f43594"/>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <serial>679d5805-0f4b-4723-a37c-a22d58f43594</serial>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]: </disk>
May 26 05:02:55.707546 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:02:56.460444 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:56.460945 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing instance network info cache due to event network-changed-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:02:56.460945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] Acquiring lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:02:56.460945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] Acquired lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:02:56.460945 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Refreshing network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:02:56.495258 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:56.837857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:56.957367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:56.957549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:56.957766 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:56.958181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:56.958181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:56.963343 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Terminating instance
May 26 05:02:56.967120 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:57.068223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771777.0653868, e91a9807-3af1-440f-8391-32c1221de940 => ua-679d5805-0f4b-4723-a37c-a22d58f43594> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:02:57.068223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-679d5805-0f4b-4723-a37c-a22d58f43594 for instance e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:02:57.070736 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Successfully detached device vdb from instance e91a9807-3af1-440f-8391-32c1221de940 from the live domain config.
May 26 05:02:57.071804 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:02:57.072091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:57.072232 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:57.072573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:57.072865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '679d5805-0f4b-4723-a37c-a22d58f43594', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:02:57.072988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:57.105700 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsi session list stdout=tcp: [40] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [41] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:57.106180 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:57.106180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '40'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '41'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088', '61')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:02:57.106599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '40')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:57.108084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594', '41')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:57.109519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4589f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:02:57.109801 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:02:57.110104 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Flush multipath device 33000000050e736e4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:02:57.155284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:57.221350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:57.266742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:02:57.268348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:02:57.268348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:02:57.295086 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:02:57.296218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:02:57.331237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.379272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.40.100,3260]
May 26 05:02:57.379272 np0000001388 nova-compute[98319]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.40.100,3260] successful.
May 26 05:02:57.379272 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.404883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.420680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.449589 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:57.470752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.50.100,3260]
May 26 05:02:57.470752 np0000001388 nova-compute[98319]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-679d5805-0f4b-4723-a37c-a22d58f43594, portal: 192.168.50.100,3260] successful.
May 26 05:02:57.470752 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.472545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:02:57.502795 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:57.503060 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:57.503226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] <== disconnect_volume: return (430ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:57.503385 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:02:57.505727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.511359 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.536154 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.540911 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.561400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.568437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.686179 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updated VIF entry in instance network info cache for port f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:02:57.687364 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [{"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:02:57.734498 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:02:57.735016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:57.737364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:57.737364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:57.737364 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] No waiting events found dispatching network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:02:57.737364 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e96a9221-44c5-47a1-945d-14ba5f1c6ac0 req-5684909a-2afc-447c-9a82-ed3e4b2193d1 service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:02:57.814794 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.828703 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:57.836125 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999624466000114 future=<Future at 0x7d7aa443c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:57.837413 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999105316000168 future=<Future at 0x7d7aa443c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:57.837413 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998953395000171 future=<Future at 0x7d7aa443c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:02:57.840635 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Instance destroyed successfully.
May 26 05:02:57.841992 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lazy-loading 'resources' on Instance uuid 833f5c94-6742-454b-a72e-75930e6b3aff {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:58.085857 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'flavor' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:58.195835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-281658f2-97dd-4f3f-b5b5-4b650cdbac44 req-af3eebd4-446c-4ec7-aedd-0ba1e16c3024 service nova] Releasing lock "refresh_cache-833f5c94-6742-454b-a72e-75930e6b3aff" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:02:58.346120 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBackupRestore-server-1843753624',display_name='tempest-TestVolumeBackupRestore-server-1843753624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebackuprestore-server-1843753624',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOqKCE3dQ56x11GmmSAYA7F5qVo8S1wO1uL5jJ1mfGmdF8VgyPLWmI8MI4wJQIzEAdveygvazUBEG46kKnWeJ6GilNCoBPvh+nLWVL4WQ4WOhTZlsMYTvXFgAgDmxBt4w==',key_name='tempest-TestVolumeBackupRestore-1883569700',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:21Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fa36a5abcae34ede974ef08e44316802',ramdisk_id='',reservation_id='r-yt3bmkv2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBackupRestore-2077017730',owner_user_name='tempest-TestVolumeBackupRestore-2077017730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:22Z,user_data=None,user_id='4b28a85d2f1144c9913761b58832f46e',uuid=833f5c94-6742-454b-a72e-75930e6b3aff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:02:58.347440 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converting VIF {"id": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "address": "fa:16:3e:1b:75:ad", "network": {"id": "0d0d4d01-a7fa-49f4-8a81-b3361e5b759e", "bridge": "br-int", "label": "tempest-TestVolumeBackupRestore-1598303902-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "fa36a5abcae34ede974ef08e44316802", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf02c97a4-f5", "ovs_interfaceid": "f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:02:58.347440 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:02:58.347440 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:02:58.348495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.348729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf02c97a4-f5, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:58.351497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a72bded6-78cc-4768-b1e8-d07567e078c1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.357833 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:02:58.362564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:02:58.363188 np0000001388 nova-compute[98319]: INFO os_vif [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:75:ad,bridge_name='br-int',has_traffic_filtering=True,id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb,network=Network(0d0d4d01-a7fa-49f4-8a81-b3361e5b759e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf02c97a4-f5')
May 26 05:02:58.364731 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:02:58.365258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:02:58.365715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:02:58.366276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:02:58.366647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b33f67c7-7b54-41bc-92fb-67edd8113c29', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:02:58.366874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:58.402344 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsi session list stdout=tcp: [45] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: tcp: [61] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088 (non-flash)
May 26 05:02:58.403001 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e4889492-4b70-4ca3-a877-552e0b1ad088', '61')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:02:58.403001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '45')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:58.404548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29', '46')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:02:58.405875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44427a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:02:58.406006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:02:58.406208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Flush multipath device 330000000955f1491 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:02:58.457323 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:58.505612 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:02:58.553517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:02:58.553517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:02:58.554740 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:02:58.566911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:02:58.567046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:02:58.580980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.626808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.40.100,3260]
May 26 05:02:58.626808 np0000001388 nova-compute[98319]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.40.100,3260] successful.
May 26 05:02:58.626808 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.648111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.659312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.697888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.50.100,3260]
May 26 05:02:58.697888 np0000001388 nova-compute[98319]: Logout of [sid: 46, target: iqn.2023-03.storpool.com:os--volume-b33f67c7-7b54-41bc-92fb-67edd8113c29, portal: 192.168.50.100,3260] successful.
May 26 05:02:58.697888 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.724610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:02:58.724858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:02:58.724974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] <== disconnect_volume: return (359ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:02:58.725075 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:02:58.725383 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Deleting instance files /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff_del
May 26 05:02:58.725869 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Deletion of /opt/stack/data/nova/instances/833f5c94-6742-454b-a72e-75930e6b3aff_del complete
May 26 05:02:58.746427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:02:58.746714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:02:58.748044 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:02:59.092175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa045838-750b-4530-a741-830aaf545fb0 tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.022s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:02:59.240892 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Took 1.77 seconds to destroy the instance on the hypervisor.
May 26 05:02:59.241754 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:02:59.241981 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:02:59.242114 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:02:59.242361 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:59.253231 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:59.369354 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:02:59.813355 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'pci_requests' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:00.021964 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:00.022101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] Acquiring lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:00.025019 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:00.025301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] Lock "833f5c94-6742-454b-a72e-75930e6b3aff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:00.025464 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] No waiting events found dispatching network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:00.025619 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-89d2fa48-0151-43c6-86d5-d64401506570 req-5833db42-2143-419d-ae77-17856a755d6c service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-unplugged-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:00.055628 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:00.055847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:00.056017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:00.056189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:00.056373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:00.059045 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Terminating instance
May 26 05:03:00.095917 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b542e9db-be5f-435c-97eb-7d17751ec5f7 req-3c1bdd0f-6474-4703-8246-a8cf4bf38cfd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Received event network-vif-deleted-f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:00.096390 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-b542e9db-be5f-435c-97eb-7d17751ec5f7 req-3c1bdd0f-6474-4703-8246-a8cf4bf38cfd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Neutron deleted interface f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb; detaching it from the instance and deleting it from the info cache
May 26 05:03:00.096502 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b542e9db-be5f-435c-97eb-7d17751ec5f7 req-3c1bdd0f-6474-4703-8246-a8cf4bf38cfd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:00.272293 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:00.316945 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Object Instance<02578b5c-b022-4d9a-ac22-3552d7e39881> lazy-loaded attributes: flavor,pci_requests {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:03:00.316945 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:03:00.317146 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:00.317655 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:00.424274 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03dbcb5077f54cfb92f9af2ed9e51ba9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6947ca5ef3684f329c6584405e98f535', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:03:00.563142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:00.602573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.605375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b542e9db-be5f-435c-97eb-7d17751ec5f7 req-3c1bdd0f-6474-4703-8246-a8cf4bf38cfd service nova] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Detach interface failed, port_id=f02c97a4-f5f9-4e1e-a129-ff5b887a0fdb, reason: Instance 833f5c94-6742-454b-a72e-75930e6b3aff could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:00.607681 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.629033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.635812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.661597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.671825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.774924 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Took 1.53 seconds to deallocate network for instance.
May 26 05:03:00.903976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.916820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:00.935620 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999292520999916 future=<Future at 0x7d7aa43a07a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:00.940889 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Instance destroyed successfully.
May 26 05:03:00.945717 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lazy-loading 'resources' on Instance uuid e91a9807-3af1-440f-8391-32c1221de940 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:01.123531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.349845 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Took 0.57 seconds to detach 1 volumes for instance.
May 26 05:03:01.396873 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Successfully created port: 8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:03:01.447708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:00:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-823898949',display_name='tempest-ServerStableDeviceRescueTest-server-823898949',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverstabledevicerescuetest-server-823898949',id=17,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGI/FSn7oCJKnrgir3Rk3qBJB6LzlthHaQG+MECR8g/zke6XlHvpe8f/iQIhXCBT1ggZdEvzhejIaU5Vtr2GJY/bHcc8BNXq/EpE4MAfDnvkL+HN1Sgqoah5w1Eh65Hl9w==',key_name='tempest-keypair-303946473',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:13Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='07c7eafe2c8f4d5bac4c03e3968605a2',ramdisk_id='',reservation_id='r-h3x8rum0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1077407970',owner_user_name='tempest-ServerStableDeviceRescueTest-1077407970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='08922d29201545f0ba67ae8ac1eb77e6',uuid=e91a9807-3af1-440f-8391-32c1221de940,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:01.447951 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converting VIF {"id": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "address": "fa:16:3e:d2:77:67", "network": {"id": "0f3d6b39-8c11-41b0-bb6a-442f622edf00", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-198526474-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "07c7eafe2c8f4d5bac4c03e3968605a2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99f251d1-25", "ovs_interfaceid": "99f251d1-253d-4cbe-8b08-c3a4a9ac5f19", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:01.448590 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:01.448857 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:01.450354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.450575 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99f251d1-25, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:01.457378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.457378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:01.460889 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.461990 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.462229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91382350-12cf-43ac-8655-3abdeccb0f39) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:01.465531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.466780 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:01.470231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.472282 np0000001388 nova-compute[98319]: INFO os_vif [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:77:67,bridge_name='br-int',has_traffic_filtering=True,id=99f251d1-253d-4cbe-8b08-c3a4a9ac5f19,network=Network(0f3d6b39-8c11-41b0-bb6a-442f622edf00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99f251d1-25')
May 26 05:03:01.472626 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Deleting instance files /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940_del
May 26 05:03:01.473537 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Deletion of /opt/stack/data/nova/instances/e91a9807-3af1-440f-8391-32c1221de940_del complete
May 26 05:03:01.846779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:01.868288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:01.868765 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:01.990853 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Took 1.43 seconds to destroy the instance on the hypervisor.
May 26 05:03:01.991725 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:01.992172 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:01.992297 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:01.992572 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:02.098016 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Successfully updated port: 8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:03:02.123357 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:02.123357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:02.123597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:02.123597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:02.123755 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:02.123889 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:02.124025 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:02.124156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Acquiring lock "e91a9807-3af1-440f-8391-32c1221de940-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:02.124324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:02.124437 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] Lock "e91a9807-3af1-440f-8391-32c1221de940-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:02.124580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] No waiting events found dispatching network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:02.124728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9de51021-ace8-4b71-ab0c-c8f987518390 req-36906daf-6472-44c8-b3bb-1bc4453b1327 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-unplugged-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:02.161601 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-changed-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:02.161758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing instance network info cache due to event network-changed-8032f46e-100c-4ab0-9cfa-a4738ac85112. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:02.161801 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:02.161905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:02.162014 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Refreshing network info cache for port 8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:02.177527 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:02.391920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:02.392162 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:02.603493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:02.665996 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:02.896022 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:03.114897 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:03.263580 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Added VIF to instance network info cache for port 8032f46e-100c-4ab0-9cfa-a4738ac85112. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3530}}
May 26 05:03:03.263941 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:03.285118 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:03.402965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.534s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:03.477139 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Deleted allocations for instance 833f5c94-6742-454b-a72e-75930e6b3aff
May 26 05:03:03.766122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-230cbf69-7357-4403-b821-f7c6be6dff60 req-f4dfc031-a7d9-43fa-a4e1-cb73e99dd517 service nova] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:03.766725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:03.766884 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:03:03.787517 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e91a9807-3af1-440f-8391-32c1221de940] Took 1.80 seconds to deallocate network for instance.
May 26 05:03:04.265830 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d4a5f8d-f356-4143-9080-3d36a19cdf3e req-22671153-ab7b-4da8-af17-f9f1128d5a62 service nova] [instance: e91a9807-3af1-440f-8391-32c1221de940] Received event network-vif-deleted-99f251d1-253d-4cbe-8b08-c3a4a9ac5f19 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:04.299712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:04.299712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:04.366039 np0000001388 nova-compute[98319]: WARNING nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] d397f28c-49b6-407d-af36-86d7a61247b1 already exists in list: networks containing: ['d397f28c-49b6-407d-af36-86d7a61247b1']. ignoring it
May 26 05:03:04.366563 np0000001388 nova-compute[98319]: WARNING nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] 8032f46e-100c-4ab0-9cfa-a4738ac85112 already exists in list: port_ids containing: ['8032f46e-100c-4ab0-9cfa-a4738ac85112']. ignoring it
May 26 05:03:04.492871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2e9a1e8b-d1c9-4965-b2ea-884e594bbbc6 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Lock "833f5c94-6742-454b-a72e-75930e6b3aff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.535s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:04.615952 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:04.787228 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:04.788232 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:05.054683 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:05.274157 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:05.294908 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:05.777005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:05.780135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:03:05.780414 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:05.780948 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:05.781167 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:03:05.781456 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.781616 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:05.781785 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:03:05.782625 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.782780 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6af362eb-9f31-5140-83d8-1cd76713a5c7', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:05.783497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.784400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:05.785767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.787814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.787957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8032f46e-10, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:05.788385 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8032f46e-10, col_values=(('qos', UUID('38891f27-0572-42ae-a07d-233273d49045')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:05.788455 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8032f46e-10, col_values=(('external_ids', {'iface-id': '8032f46e-100c-4ab0-9cfa-a4738ac85112', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:57:f7', 'vm-uuid': '02578b5c-b022-4d9a-ac22-3552d7e39881'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:05.789410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.790452 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:05.803502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.503s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:05.804883 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.808944 np0000001388 nova-compute[98319]: INFO os_vif [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10')
May 26 05:03:05.809966 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:03:05.810471 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:05.811306 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:05.813001 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] attach device xml: <interface type="ethernet">
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:   <mac address="fa:16:3e:52:57:f7"/>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:   <model type="virtio"/>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:   <driver name="qemu"/>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:   <mtu size="1372"/>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:   <target dev="tap8032f46e-10"/>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]: </interface>
May 26 05:03:05.813001 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:03:05.831229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.881212 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Deleted allocations for instance e91a9807-3af1-440f-8391-32c1221de940
May 26 05:03:05.918931 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.923413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.930506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:05.986870 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.110104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:06.199998 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f06361ff-063e-49b3-adc7-5346c68b83c6 req-0cb87ef9-6af7-42c3-9d8a-23ed991d5bc0 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received unexpected event network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 for instance with vm_state active and task_state None.
May 26 05:03:06.332478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.336746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.338453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.364809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.848991 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:06.891783 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-40e74b4f-3430-411d-a6c4-13aaddc2588a tempest-ServerStableDeviceRescueTest-1077407970 tempest-ServerStableDeviceRescueTest-1077407970-project-member] Lock "e91a9807-3af1-440f-8391-32c1221de940" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.836s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:07.526796 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:07.527394 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:07.527394 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No VIF found with MAC fa:16:3e:68:cb:88, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:03:08.035215 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-156488668', uuid='02578b5c-b022-4d9a-ac22-3552d7e39881'), owner=OwnerMeta(userid='03dbcb5077f54cfb92f9af2ed9e51ba9', username='tempest-TaggedAttachmentsTest-811095965-project-member', projectid='6947ca5ef3684f329c6584405e98f535', projectname='tempest-TaggedAttachmentsTest-811095965'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771788.0348103) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:08.035933 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:08</nova:creationTime>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     <nova:port uuid="8032f46e-100c-4ab0-9cfa-a4738ac85112">
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.244" ipVersion="4"/>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:08.035933 np0000001388 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 26 05:03:08.542583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4a3bbdc0-d029-465d-919e-26ccf4d03fbf tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 9.796s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:08.761190 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:08.761355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:08.761525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:08.761673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:08.762891 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:08.763045 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e24d95e9-115f-415e-937e-105e82c4e462 req-a797948e-397b-4cf0-b9c7-57ad917889ad service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received unexpected event network-vif-plugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 for instance with vm_state active and task_state None.
May 26 05:03:08.988925 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:09.537531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:09.537786 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:09.773308 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:10.045703 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:10.803351 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:11.019837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:11.020528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:11.051846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:11.057190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:11.420082 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:11.527705 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:11.865008 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:12.030783 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Ignoring supplied device name: /dev/vdb
May 26 05:03:12.202375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:12.202582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:12.202824 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Attaching volume 99c974fb-4038-4a96-8969-c40706c2c0fb to /dev/vdb
May 26 05:03:12.256832 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:12.270062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:03:12.296023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:12.338169 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:03:12.338529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:03:12.346818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:03:12.348619 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fefc:c9eb', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fe68:cb88', 'fe80::2c0b:61ff:feff:8ac3', 'fe80::fc16:3eff:feb3:ab41', 'fe80::fc16:3eff:fedc:6e53', 'fe80::3881:53ff:fe7e:41bc', 'fe80::fc16:3eff:fecf:df18', 'fe80::fc16:3eff:feec:3f86', 'fe80::fc16:3eff:fe90:9b7d', 'fe80::fc16:3eff:fe57:42de', 'fe80::44ed:a2ff:fed0:9839', 'fe80::fc16:3eff:fe91:6a9c', 'fe80::fc16:3eff:fe9a:199a', 'fe80::b08a:4bff:fe6b:5012', 'fe80::fc16:3eff:fe52:57f7', 'fe80::2cc4:13ff:fe42:ce01'] 
May 26 05:03:12.350261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:03:12.350261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:03:12.352817 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:12.353211 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating existing volume attachment record: 0a35efa8-c803-4c22-9f21-cb463af3db20 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:03:12.532464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:12.836211 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00043294299985063844 future=<Future at 0x7d7aa443c9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:12.836356 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:12.836474 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.0983946110000034 future=<Future at 0x7d7aa43a07a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:12.836556 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.098314823000237 future=<Future at 0x7d7aa43a07a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:12.838844 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] Emitting event <LifecycleEvent: 1779771777.835668, 833f5c94-6742-454b-a72e-75930e6b3aff => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:12.838844 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] VM Stopped (Lifecycle Event)
May 26 05:03:12.945957 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:03:12.946527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:12.946660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:12.947510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:12.947510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:03:12.967687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:12.968634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:12.969475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:12.969755 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:12.970393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:12.970818 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:12.986393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:12.986393 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:12.996212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:12.996212 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:13.002630 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb] added
May 26 05:03:13.002630 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:13.002630 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:13.002630 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:13.002630 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:13.002630 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:13.002630 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:13.002939 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:13.003065 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0333(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:13.003354 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb] added
May 26 05:03:13.011654 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:13.011654 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:13.011654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:13.011982 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0413(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:13.012146 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:13.340750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5c11d64c-8aa6-4d25-b9d4-e00251400e92 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185 tempest-TestServerVolumeAttachScenarioOldVersion-1645301185-project-member] [instance: 833f5c94-6742-454b-a72e-75930e6b3aff] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:13.637738 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:13.638000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:13.638283 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Attaching volume 9f82887e-46e7-427e-8375-cb30bcfbc7c7 to /dev/vdb
May 26 05:03:13.663830 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:13.700591 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:13.716214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:03:13.743948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:13.788972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:03:13.791158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:03:13.804459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:03:13.810362 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefa:7f17', 'fe80::84e9:c9ff:fe64:3792', 'fe80::fc16:3eff:fefc:c9eb', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fe68:cb88', 'fe80::2c0b:61ff:feff:8ac3', 'fe80::fc16:3eff:feb3:ab41', 'fe80::fc16:3eff:fedc:6e53', 'fe80::3881:53ff:fe7e:41bc', 'fe80::fc16:3eff:fecf:df18', 'fe80::fc16:3eff:feec:3f86', 'fe80::fc16:3eff:fe90:9b7d', 'fe80::fc16:3eff:fe57:42de', 'fe80::44ed:a2ff:fed0:9839', 'fe80::fc16:3eff:fe91:6a9c', 'fe80::fc16:3eff:fe9a:199a', 'fe80::b08a:4bff:fe6b:5012', 'fe80::fc16:3eff:fe52:57f7', 'fe80::2cc4:13ff:fe42:ce01'] 
May 26 05:03:13.810362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:03:13.810362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:03:13.810519 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:13.810919 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating existing volume attachment record: 47418b77-d855-4f01-b0ab-d4db50b23830 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:03:14.004071 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:14.014540 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:14.022501 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:14.022501 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:14.031055 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:14.031055 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.039809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.047241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.059307 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.068162 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.068685 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:14.110153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.40.100,3260]
May 26 05:03:14.110153 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.40.100,3260] successful.
May 26 05:03:14.110153 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.118311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.50.100,3260]
May 26 05:03:14.118311 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.50.100,3260] successful.
May 26 05:03:14.118311 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.125091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.132239 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.144334 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.144936 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:14.144936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:14.145239 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:14.146028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] HCTL ('8', '-', '-', 0) found on session 62 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:14.146259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.157543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:14.157938 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:14.157938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:14.158351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:14.160494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] HCTL ('9', '-', '-', 0) found on session 63 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:14.160494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:14.164555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Searching for a device in session 62 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:14.164555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:14.181857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Searching for a device in session 63 and hctl ['9', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:14.380802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:03:14.381488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:14.381974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:15.182484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Searching for a device in session 63 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:15.182917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:15.722446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:15.810235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:15.935681 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005871719999959168 future=<Future at 0x7d7aa43a07a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:15.936617 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] Emitting event <LifecycleEvent: 1779771780.9348037, e91a9807-3af1-440f-8391-32c1221de940 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:15.937009 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:15.937237 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] VM Stopped (Lifecycle Event)
May 26 05:03:15.985177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Found WWN 3300000007c1ac16c for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:03:15.985559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:15.986554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.604s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:15.986956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000007c1ac16c', 'path': '/dev/dm-0', 'multipath_id': '3300000007c1ac16c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:15.987273 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:03:15.987641 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007c1ac16c', 'path': '/dev/dm-0', 'multipath_id': '3300000007c1ac16c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:03:15.989996 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:16.000563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:16.001146 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:16.001933 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:16.001933 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:16.002227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:16.002452 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:16.017105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:16.017105 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:16.024713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:16.024713 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7] added
May 26 05:03:16.030564 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:16.030564 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0284(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:16.030564 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:16.035967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7] added
May 26 05:03:16.035967 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:16.035967 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:16.035967 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:16.035967 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:16.035967 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:16.035967 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:16.036227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:16.036291 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:16.036414 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:16.441006 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-536e7df7-a510-47d8-8ff3-391b18f600cd tempest-TaggedBootDevicesTest-1451569092 tempest-TaggedBootDevicesTest-1451569092-project-member] [instance: e91a9807-3af1-440f-8391-32c1221de940] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:16.493095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Attempting to attach volume 99c974fb-4038-4a96-8969-c40706c2c0fb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:03:16.494279 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:   <alias name="ua-99c974fb-4038-4a96-8969-c40706c2c0fb"/>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:   <serial>99c974fb-4038-4a96-8969-c40706c2c0fb</serial>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:16.494279 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:03:16.674031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:16.870391 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:17.031262 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:17.041253 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:17.048348 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:17.048348 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:17.057875 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:17.057875 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.064840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.074402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.083395 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.093121 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.093526 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:17.137076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.40.100,3260]
May 26 05:03:17.137076 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.40.100,3260] successful.
May 26 05:03:17.137076 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.153466 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.162170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.50.100,3260]
May 26 05:03:17.162170 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.50.100,3260] successful.
May 26 05:03:17.162170 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.176453 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:17.177178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:17.177178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:17.178138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:17.179990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] HCTL ('10', '-', '-', 0) found on session 64 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:17.180125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:17.205634 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:17.205634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:17.207061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching for a device in session 64 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:17.207061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:17.207061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] HCTL ('11', '-', '-', 0) found on session 65 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:17.208267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:17.223572 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching for a device in session 65 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:17.223790 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:18.003724 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:03:18.182652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:18.184948 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:18.184948 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] No VIF found with MAC fa:16:3e:68:cb:88, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:03:18.599567 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:19.021313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found WWN 330000000e910d809 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:03:19.021766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:19.021766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== connect_volume: return (4640ms) {'type': 'block', 'scsi_wwn': '330000000e910d809', 'path': '/dev/dm-1', 'multipath_id': '330000000e910d809'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:19.021907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e910d809', 'path': '/dev/dm-1', 'multipath_id': '330000000e910d809'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:03:19.024818 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:19.528042 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Attempting to attach volume 9f82887e-46e7-427e-8375-cb30bcfbc7c7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:03:19.530132 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:   <alias name="ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7"/>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:   <serial>9f82887e-46e7-427e-8375-cb30bcfbc7c7</serial>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:19.530132 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:03:19.753269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-da642b0b-9158-4e74-b2ac-278202bf9bd6 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.550s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:20.745861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:20.746328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:20.809127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:21.239658 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:21.239839 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:21.240007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:21.240154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No VIF found with MAC fa:16:3e:fc:c9:eb, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:03:21.249769 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:03:21.462558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:21.462558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:21.836465 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:21.837318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:21.843521 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:03:21.843705 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Claim successful on node np0000001388
May 26 05:03:21.868699 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:21.964486 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Detaching volume 99c974fb-4038-4a96-8969-c40706c2c0fb
May 26 05:03:22.008995 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Attempting to driver detach volume 99c974fb-4038-4a96-8969-c40706c2c0fb from mountpoint /dev/vdb
May 26 05:03:22.012837 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Found disk vdb by alias ua-99c974fb-4038-4a96-8969-c40706c2c0fb {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:03:22.013896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Found disk vdb by alias ua-99c974fb-4038-4a96-8969-c40706c2c0fb {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:03:22.014026 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Attempting to detach device vdb from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:03:22.014506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <alias name="ua-99c974fb-4038-4a96-8969-c40706c2c0fb"/>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <serial>99c974fb-4038-4a96-8969-c40706c2c0fb</serial>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:22.014506 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:22.020343 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully detached device vdb from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the persistent domain config.
May 26 05:03:22.020555 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] (1/8): Attempting to detach device vdb with device alias ua-99c974fb-4038-4a96-8969-c40706c2c0fb from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:03:22.020875 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <alias name="ua-99c974fb-4038-4a96-8969-c40706c2c0fb"/>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <serial>99c974fb-4038-4a96-8969-c40706c2c0fb</serial>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:22.020875 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:22.211005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:22.211218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:22.615428 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771802.6150506, 02578b5c-b022-4d9a-ac22-3552d7e39881 => ua-99c974fb-4038-4a96-8969-c40706c2c0fb> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:03:22.617358 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-99c974fb-4038-4a96-8969-c40706c2c0fb for instance 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:03:22.619685 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully detached device vdb from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the live domain config.
May 26 05:03:22.620621 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:22.620868 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:22.620980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:22.714641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:03:22.800470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fa01a0dd-a75a-4ccb-833c-844e4bf43201 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:23.310244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:23.415919 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:23.416219 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:23.577572 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.956s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:23.577572 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '99c974fb-4038-4a96-8969-c40706c2c0fb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:23.578259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:23.622692 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [62] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [63] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:23.623158 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', '62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', '63'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6', '67')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:23.623158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', '62')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:23.624270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb', '63')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:23.625322 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac431db20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:23.625527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Removing multipathed devices sdd, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:23.625749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Flush multipath device 3300000007c1ac16c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:23.670074 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:23.724220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:23.758098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Checking to see if SCSI volumes sdd, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:23.758396 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] SCSI volumes sdd, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:23.759999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Checking to see if device paths {'sdd', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:23.773189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Device paths {'sdd', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:23.773488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:23.787777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.830430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.40.100,3260]
May 26 05:03:23.830430 np0000001388 nova-compute[98319]: Logout of [sid: 62, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.40.100,3260] successful.
May 26 05:03:23.830430 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.885343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.899486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.922334 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:23.947321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.50.100,3260]
May 26 05:03:23.947321 np0000001388 nova-compute[98319]: Logout of [sid: 63, target: iqn.2023-03.storpool.com:os--volume-99c974fb-4038-4a96-8969-c40706c2c0fb, portal: 192.168.50.100,3260] successful.
May 26 05:03:23.947321 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.971641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:23.972417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:23.972417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] <== disconnect_volume: return (1351ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:23.972417 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:24.431061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.594s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:24.431525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:03:24.434988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.125s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:24.444254 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:03:24.444496 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Claim successful on node np0000001388
May 26 05:03:24.558533 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:24.938225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:03:24.938845 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:03:24.939189 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:24.939541 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:25.044230 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1d031958ee54c7c91fff69e00d93a73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa950105770e40f29f0967e1eefd8211', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:03:25.444072 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:03:25.705364 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.705364 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.705364 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.705588 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.705780 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.705928 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.706132 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.706724 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:03:25.706724 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:25.765040 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Successfully created port: d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:03:25.773807 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-8032f46e-100c-4ab0-9cfa-a4738ac85112" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:25.774082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-8032f46e-100c-4ab0-9cfa-a4738ac85112" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:25.812819 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:25.953226 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:03:25.971562 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:25.971812 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:26.079659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f604139c-882f-447b-bd32-bdcce0f2d77c tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.618s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:26.214032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:26.279886 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:26.396082 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Successfully updated port: d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:03:26.459595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-changed-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:26.459595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Refreshing instance network info cache due to event network-changed-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:26.459595 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] Acquiring lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:26.472797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] Acquired lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:26.474606 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Refreshing network info cache for port d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:26.479626 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:26.622907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:26.622907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:26.623156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:26.623813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:26.623813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:26.626321 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Terminating instance
May 26 05:03:26.783697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:03:26.783971 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:26.784524 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:26.786544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:26.789492 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:26.791228 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Attempting to detach device tap8032f46e-10 from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:03:26.794227 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] detach device xml: <interface type="ethernet">
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:   <mac address="fa:16:3e:52:57:f7"/>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:   <model type="virtio"/>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:   <driver name="qemu"/>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:   <mtu size="1372"/>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:   <target dev="tap8032f46e-10"/>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]: </interface>
May 26 05:03:26.794227 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:26.798244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:26.800315 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface>not found in domain: <domain type='qemu' id='31'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <name>instance-00000019</name>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <uuid>02578b5c-b022-4d9a-ac22-3552d7e39881</uuid>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:08</nova:creationTime>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <nova:port uuid="8032f46e-100c-4ab0-9cfa-a4738ac85112">
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.244" ipVersion="4"/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <resource>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <partition>/machine</partition>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </resource>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <sysinfo type='smbios'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='serial'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='uuid'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <boot dev='hd'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <clock offset='utc'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <disk type='file' device='disk'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk' index='2'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <backingStore type='file' index='3'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:         <format type='raw'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:         <backingStore/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       </backingStore>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config' index='1'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <backingStore/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <readonly/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='usb'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='pci.0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <controller type='ide' index='0'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='ide'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <interface type='ethernet'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <mac address='fa:16:3e:68:cb:88'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target dev='tapf2a35255-f2'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <model type='virtio'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <driver name='qemu'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <mtu size='1372'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='net0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <interface type='ethernet'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <mac address='fa:16:3e:52:57:f7'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target dev='tap8032f46e-10'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <model type='virtio'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <driver name='qemu'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <mtu size='1372'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='net1'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <serial type='pty'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:         <model name='isa-serial'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       </target>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <console type='pty' tty='/dev/pts/2'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <target type='serial' port='0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </console>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='input0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='input1'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </graphics>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <audio id='1' type='none'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='video0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <stats period='10'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='balloon0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <rng model='virtio'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <alias name='rng0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <label>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</label>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <imagelabel>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</imagelabel>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <label>+64055:+993</label>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:26.800315 np0000001388 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 26 05:03:26.807147 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully detached device tap8032f46e-10 from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the persistent domain config.
May 26 05:03:26.807147 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] (1/8): Attempting to detach device tap8032f46e-10 with device alias net1 from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:03:26.807147 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] detach device xml: <interface type="ethernet">
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:   <mac address="fa:16:3e:52:57:f7"/>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:   <model type="virtio"/>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:   <driver name="qemu"/>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:   <mtu size="1372"/>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:   <target dev="tap8032f46e-10"/>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]: </interface>
May 26 05:03:26.807147 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:26.870348 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:26.900008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:26.992044 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:03:26.992044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:03:26.992044 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Creating image(s)
May 26 05:03:26.992671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:26.993121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:26.993942 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:26.996582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.562s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:26.998810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:26.999309 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.784s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:26.999558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:26.999761 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:03:27.001296 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:03:27.006343 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:27.011797 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:27.015433 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:27.133789 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:03:27.138689 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:27.144102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.129s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:27.144905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:27.146023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:27.146728 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:27.153229 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:27.153229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:27.172151 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.175362 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.201757 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.260533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:27.261610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:27.376158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.380435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk 1073741824" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:27.381265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:27.381463 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:27.381678 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.413466 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:27.501161 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:27.501668 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Checking if we can resize image /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:03:27.502105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:27.523099 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99842606500033 future=<Future at 0x7d7ac4111670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:27.535921 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.986776807000297 future=<Future at 0x7d7ac4111670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:27.535921 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.986542021000332 future=<Future at 0x7d7ac4111670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:27.542830 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:03:27.543028 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:03:27.543865 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:27.546582 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:27.563687 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:27.569797 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Instance destroyed successfully.
May 26 05:03:27.570163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:27.572869 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:27.577693 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'resources' on Instance uuid ec4ecad1-7f2e-4026-b3c5-be40769b3a19 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:27.579225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:27.579225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:27.579329 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cfe58a6d-e3f8-4799-829f-9da6b474ebea req-42b0b1b8-783b-4d96-8bd1-be1f17838bb3 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:27.619062 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:27.620961 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Cannot resize image /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:03:27.623241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:03:27.623940 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Ensure instance console log exists: /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:03:27.624261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:27.626256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:27.626256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:27.663532 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdb1ab2deb1f45f3a5cb5374e0e8dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6925a7d36eb4b919388468635037918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:03:27.920644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-05b2bd07-04ac-4526-96e2-d3440d8ab78f req-bd688d5e-3051-4664-adbd-973362a477a2 service nova] Releasing lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:27.922974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquired lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:27.923115 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:03:27.930818 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771807.930037, 02578b5c-b022-4d9a-ac22-3552d7e39881 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:03:27.932443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Start waiting for the detach event from libvirt for device tap8032f46e-10 with device alias net1 for instance 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:03:27.932443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:27.937121 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface>not found in domain: <domain type='qemu' id='31'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <name>instance-00000019</name>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <uuid>02578b5c-b022-4d9a-ac22-3552d7e39881</uuid>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:08</nova:creationTime>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <nova:port uuid="8032f46e-100c-4ab0-9cfa-a4738ac85112">
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.10.10.244" ipVersion="4"/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <resource>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <partition>/machine</partition>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </resource>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <sysinfo type='smbios'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='serial'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='uuid'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <boot dev='hd'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <clock offset='utc'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <disk type='file' device='disk'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk' index='2'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <backingStore type='file' index='3'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:         <format type='raw'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:         <backingStore/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       </backingStore>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config' index='1'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <backingStore/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <readonly/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='usb'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='pci.0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <controller type='ide' index='0'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='ide'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <interface type='ethernet'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <mac address='fa:16:3e:68:cb:88'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <target dev='tapf2a35255-f2'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <model type='virtio'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <driver name='qemu'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <mtu size='1372'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='net0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <serial type='pty'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:         <model name='isa-serial'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       </target>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <console type='pty' tty='/dev/pts/2'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <target type='serial' port='0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </console>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='input0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='input1'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </graphics>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <audio id='1' type='none'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='video0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <stats period='10'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='balloon0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <rng model='virtio'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <alias name='rng0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <label>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</label>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <imagelabel>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</imagelabel>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <label>+64055:+993</label>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:27.937121 np0000001388 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 26 05:03:27.937121 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully detached device tap8032f46e-10 from instance 02578b5c-b022-4d9a-ac22-3552d7e39881 from the live domain config.
May 26 05:03:27.954102 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:27.954102 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:27.954102 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:27.954102 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:27.954102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.957172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8032f46e-10, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:27.959785 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.960763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:27.976096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:27.981772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.001668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.009187 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.011730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.011730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38891f27-0572-42ae-a07d-233273d49045) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:28.014277 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:28.039153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.044334 np0000001388 nova-compute[98319]: INFO os_vif [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10')
May 26 05:03:28.045706 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-156488668', uuid='02578b5c-b022-4d9a-ac22-3552d7e39881'), owner=OwnerMeta(userid='03dbcb5077f54cfb92f9af2ed9e51ba9', username='tempest-TaggedAttachmentsTest-811095965-project-member', projectid='6947ca5ef3684f329c6584405e98f535', projectname='tempest-TaggedAttachmentsTest-811095965'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771808.0452092) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:28.047630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:28</nova:creationTime>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:28.047630 np0000001388 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 26 05:03:28.053044 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:28.053548 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:28.056318 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:03:28.081224 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-696737626',display_name='tempest-ServerActionsTestOtherA-server-696737626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-696737626',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-qmiitmv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=ec4ecad1-7f2e-4026-b3c5-be40769b3a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:28.081579 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "0f10a0b5-86a5-4382-99e5-e170ea108458", "address": "fa:16:3e:9a:19:9a", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f10a0b5-86", "ovs_interfaceid": "0f10a0b5-86a5-4382-99e5-e170ea108458", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:28.083132 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:28.083132 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:28.085248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.086520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f10a0b5-86, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:28.089167 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.090186 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:28.091321 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.092312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.092806 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=578e5b61-30eb-42ff-923a-f7014bb4f46e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:28.093370 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.094231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:28.095267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:28.097624 np0000001388 nova-compute[98319]: INFO os_vif [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:19:9a,bridge_name='br-int',has_traffic_filtering=True,id=0f10a0b5-86a5-4382-99e5-e170ea108458,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f10a0b5-86')
May 26 05:03:28.099406 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:28.099847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:28.100050 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:28.100619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:28.101143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:28.101143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:28.109587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:28.169747 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [56] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [57] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:28.170173 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:28.170450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '56'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '57'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa', '68')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:28.170660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '57')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:28.172349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f', '56')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:28.174313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f0900>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'): ({'sdo'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:28.174313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Removing multipathed devices sdp, sdo {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:28.174645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Flush multipath device 3300000001daa20bc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:28.227052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:28.230039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.230799 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.281758 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:28.343175 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if SCSI volumes sdp, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:28.343688 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] SCSI volumes sdp, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:28.351952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Checking to see if device paths {'sdp', 'sdo'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:28.363950 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.366316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Device paths {'sdp', 'sdo'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:28.366316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:28.367234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:03:28.375661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.392940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.438718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260]
May 26 05:03:28.438718 np0000001388 nova-compute[98319]: Logout of [sid: 57, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.40.100,3260] successful.
May 26 05:03:28.438718 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.464625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.479735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.527312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260]
May 26 05:03:28.527312 np0000001388 nova-compute[98319]: Logout of [sid: 56, target: iqn.2023-03.storpool.com:os--volume-5af35d79-38f2-4c5a-bfc7-61d05f88f05f, portal: 192.168.50.100,3260] successful.
May 26 05:03:28.527312 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.533738 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.537915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.562768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:28.563752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:28.563949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] <== disconnect_volume: return (464ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:28.564324 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:28.564747 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Deleting instance files /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19_del
May 26 05:03:28.568426 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:03:28.578443 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Deletion of /opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19_del complete
May 26 05:03:28.598129 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:03:28.659991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:28.662338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:28.662583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:28.664952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:28.666183 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:28.666435 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-37787b11-253e-4371-b3fc-16caf39bd9a8 req-484d180f-76a7-4ce5-8199-ff7b3933c1e9 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received unexpected event network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 for instance with vm_state active and task_state None.
May 26 05:03:28.693413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.697596 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000014, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/ec4ecad1-7f2e-4026-b3c5-be40769b3a19/disk.config'
May 26 05:03:28.701450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:03:28.701450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:03:28.701450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-2 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:03:28.703300 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.745503 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-deleted-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:28.745503 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Neutron deleted interface 8032f46e-100c-4ab0-9cfa-a4738ac85112; detaching it from the instance and deleting it from the info cache
May 26 05:03:28.745503 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:28.794357 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Successfully created port: b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:03:28.811273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.812404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.913408 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:28.926986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.932184 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:03:28.933782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:28.980664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:28.984629 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12313MB free_disk=73.19952011108398GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:03:28.987581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:28.991706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:29.083802 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating instance_info_cache with network_info: [{"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:29.093215 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Took 1.95 seconds to destroy the instance on the hypervisor.
May 26 05:03:29.093970 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:29.094208 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:29.094308 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:29.094702 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:29.182340 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:29.254603 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Lazy-loading 'system_metadata' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:29.559192 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Successfully updated port: b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:03:29.592310 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Releasing lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:29.592654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance network_info: |[{"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:03:29.596594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Start _get_guest_xml network_info=[{"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:03:29.598913 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:03:29.599894 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:03:29.600214 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating image(s)
May 26 05:03:29.600960 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:29.601152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:29.601723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:29.602382 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:29.603841 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:03:29.605278 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesExtendAttachedTest-instance-1899204431', uuid='477377b6-cc48-467a-a9a6-d7f2c7be8743'), owner=OwnerMeta(userid='f1d031958ee54c7c91fff69e00d93a73', username='tempest-VolumesExtendAttachedTest-1174418108-project-member', projectid='aa950105770e40f29f0967e1eefd8211', projectname='tempest-VolumesExtendAttachedTest-1174418108'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771809.6048946) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:29.609494 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:29.610508 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:03:29.611018 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:03:29.612653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:29.642216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:29.650418 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:03:29.651100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] Acquiring lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:29.651481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:29.651651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:29.652661 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:03:29.657321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] No waiting events found dispatching network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:29.657519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2510e122-cef5-42ba-a8bf-e9891d991618 req-e85cdb4c-fff7-47bb-bd0f-52ef7706beb0 service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-unplugged-0f10a0b5-86a5-4382-99e5-e170ea108458 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:29.657923 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:03:29.658509 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:03:29.658779 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:03:29.658919 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:03:29.659048 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:03:29.659377 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:03:29.660417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:03:29.683113 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1899204431',display_name='tempest-VolumesExtendAttachedTest-instance-1899204431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesextendattachedtest-instance-1899204431',id=26,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmncgNQjyvYzaaxEZU+qC9SWYahj5bLj/r79tml2hisobffHeo2e5zc6gGIOXDe893p1oXI+emkF+4Uqu4Kp0bLWyTDEtJ3fOZ1N4TvEQGrNuHaC2tgur4Pq5nYjYzGw==',key_name='tempest-keypair-829574181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa950105770e40f29f0967e1eefd8211',ramdisk_id='',reservation_id='r-umnrvmek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1174418108',owner_user_name='tempest-VolumesExtendAttachedTest-1174418108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1d031958ee54c7c91fff69e00d93a73',uuid=477377b6-cc48-467a-a9a6-d7f2c7be8743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:03:29.683801 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converting VIF {"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:29.684078 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:29.684755 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lazy-loading 'pci_devices' on Instance uuid 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:29.721012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:29.723661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:29.723661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:29.723661 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:29.728935 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:29.729431 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:29.762225 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Lazy-loading 'flavor' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:29.826600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:29.827001 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:29.880219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:29.880219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:29.880219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:29.964868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:29.965391 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:03:29.965663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:30.063986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:30.064870 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:30.065118 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:03:30.077689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:30.078137 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Cannot resize image /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:03:30.078892 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:03:30.078892 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Ensure instance console log exists: /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:03:30.080976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:30.080976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:30.080976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:30.091856 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f40c13f1-a910-4f6a-b000-2baa84ce86fa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.092039 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.092246 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 71b40a96-611b-4143-a895-e464b0ce391d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.092661 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 02578b5c-b022-4d9a-ac22-3552d7e39881 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.092803 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance ec4ecad1-7f2e-4026-b3c5-be40769b3a19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 256}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.092935 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.093055 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fa807765-450a-493a-b193-fe0d0fcfcb72 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:03:30.093415 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:03:30.093592 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1920MB phys_disk=95GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:03:28 up 35 min,  2 users,  load average: 8.47, 6.95, 3.59\n', 'num_instances': '7', 'num_vm_active': '5', 'num_task_None': '4', 'num_os_type_None': '7', 'num_proj_278ea77812db4e90a14904f104739285': '2', 'io_workload': '2', 'num_proj_ba1a070782e1452690c54eb9a95cb8d3': '1', 'num_proj_c32d47b7a83249e09dab2cfa30367843': '1', 'num_proj_6947ca5ef3684f329c6584405e98f535': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_aa950105770e40f29f0967e1eefd8211': '1', 'num_task_block_device_mapping': '1', 'num_proj_b6925a7d36eb4b919388468635037918': '1', 'num_task_deleting': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:03:30.158497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:30.159130 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquired lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:30.160180 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:03:30.182296 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:30.189012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] End _get_guest_xml xml=<domain type="qemu">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <uuid>477377b6-cc48-467a-a9a6-d7f2c7be8743</uuid>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <name>instance-0000001a</name>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesExtendAttachedTest-instance-1899204431</nova:name>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:03:29</nova:creationTime>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:user uuid="f1d031958ee54c7c91fff69e00d93a73">tempest-VolumesExtendAttachedTest-1174418108-project-member</nova:user>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:project uuid="aa950105770e40f29f0967e1eefd8211">tempest-VolumesExtendAttachedTest-1174418108</nova:project>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         <nova:port uuid="d1cd2bd8-9a23-4af8-8c22-084c4b0d5850">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="serial">477377b6-cc48-467a-a9a6-d7f2c7be8743</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="uuid">477377b6-cc48-467a-a9a6-d7f2c7be8743</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.config"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:65:7d:be"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <target dev="tapd1cd2bd8-9a"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/console.log" append="off"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:30.189012 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Preparing to wait for external event network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1899204431',display_name='tempest-VolumesExtendAttachedTest-instance-1899204431',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesextendattachedtest-instance-1899204431',id=26,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmncgNQjyvYzaaxEZU+qC9SWYahj5bLj/r79tml2hisobffHeo2e5zc6gGIOXDe893p1oXI+emkF+4Uqu4Kp0bLWyTDEtJ3fOZ1N4TvEQGrNuHaC2tgur4Pq5nYjYzGw==',key_name='tempest-keypair-829574181',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa950105770e40f29f0967e1eefd8211',ramdisk_id='',reservation_id='r-umnrvmek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesExtendAttachedTest-1174418108',owner_user_name='tempest-VolumesExtendAttachedTest-1174418108-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1d031958ee54c7c91fff69e00d93a73',uuid=477377b6-cc48-467a-a9a6-d7f2c7be8743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converting VIF {"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:30.191748 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:30.192657 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:03:30.192657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.192657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.192831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:03:30.194500 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.194670 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ff212651-e43d-559f-8550-ebe994c3b557', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.195521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.196448 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:30.198501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.202972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.202972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1cd2bd8-9a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.202972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1cd2bd8-9a, col_values=(('qos', UUID('de453c40-2436-453d-946d-cc446070c81e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.202972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1cd2bd8-9a, col_values=(('external_ids', {'iface-id': 'd1cd2bd8-9a23-4af8-8c22-084c4b0d5850', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:7d:be', 'vm-uuid': '477377b6-cc48-467a-a9a6-d7f2c7be8743'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.203220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.206444 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:30.211318 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.213024 np0000001388 nova-compute[98319]: INFO os_vif [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a')
May 26 05:03:30.269688 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Object Instance<02578b5c-b022-4d9a-ac22-3552d7e39881> lazy-loaded attributes: system_metadata,flavor {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:03:30.270442 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:03:30.270620 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:30.271151 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:30.273172 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:30.275268 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface>not found in domain: <domain type='qemu' id='31'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <name>instance-00000019</name>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <uuid>02578b5c-b022-4d9a-ac22-3552d7e39881</uuid>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:28</nova:creationTime>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <resource>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <partition>/machine</partition>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </resource>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <sysinfo type='smbios'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='serial'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='uuid'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <boot dev='hd'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <clock offset='utc'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <disk type='file' device='disk'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk' index='2'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <backingStore type='file' index='3'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:         <format type='raw'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:         <backingStore/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       </backingStore>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config' index='1'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <backingStore/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <readonly/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='usb'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='pci.0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <controller type='ide' index='0'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='ide'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <interface type='ethernet'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <mac address='fa:16:3e:68:cb:88'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <target dev='tapf2a35255-f2'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <model type='virtio'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <driver name='qemu'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <mtu size='1372'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='net0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <serial type='pty'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:         <model name='isa-serial'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       </target>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <console type='pty' tty='/dev/pts/2'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <target type='serial' port='0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </console>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='input0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='input1'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </graphics>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <audio id='1' type='none'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='video0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <stats period='10'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='balloon0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <rng model='virtio'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <alias name='rng0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <label>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</label>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <imagelabel>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</imagelabel>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <label>+64055:+993</label>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:30.275268 np0000001388 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface> {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}}
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:52:57:f7"/><model type="virtio"/><driver name="qemu"/><mtu size="1372"/><target dev="tap8032f46e-10"/></interface>not found in domain: <domain type='qemu' id='31'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <name>instance-00000019</name>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <uuid>02578b5c-b022-4d9a-ac22-3552d7e39881</uuid>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:28</nova:creationTime>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <memory unit='KiB'>196608</memory>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <currentMemory unit='KiB'>196608</currentMemory>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <vcpu placement='static'>1</vcpu>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <resource>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <partition>/machine</partition>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </resource>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <sysinfo type='smbios'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='manufacturer'>OpenStack Foundation</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='product'>OpenStack Nova</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='version'>33.1.0</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='serial'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='uuid'>02578b5c-b022-4d9a-ac22-3552d7e39881</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <entry name='family'>Virtual Machine</entry>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <type arch='x86_64' machine='pc-i440fx-noble'>hvm</type>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <boot dev='hd'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <smbios mode='sysinfo'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <vmcoreinfo state='on'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <tb-cache unit='KiB'>131072</tb-cache>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <cpu mode='custom' match='exact' check='full'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <model fallback='forbid'>Nehalem</model>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <feature policy='require' name='hypervisor'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <clock offset='utc'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <on_poweroff>destroy</on_poweroff>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <on_reboot>restart</on_reboot>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <on_crash>destroy</on_crash>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <disk type='file' device='disk'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <driver name='qemu' type='qcow2' cache='none'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk' index='2'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <backingStore type='file' index='3'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:         <format type='raw'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:         <source file='/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:         <backingStore/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       </backingStore>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <target dev='vda' bus='virtio'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='virtio-disk0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <disk type='file' device='cdrom'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <driver name='qemu' type='raw' cache='none'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <source file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/disk.config' index='1'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <backingStore/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <target dev='hda' bus='ide'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <readonly/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='ide0-0-0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <controller type='usb' index='0' model='none'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='usb'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <controller type='pci' index='0' model='pci-root'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='pci.0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <controller type='ide' index='0'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='ide'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </controller>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <interface type='ethernet'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <mac address='fa:16:3e:68:cb:88'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <target dev='tapf2a35255-f2'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <model type='virtio'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <driver name='qemu'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <mtu size='1372'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='net0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <serial type='pty'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <target type='isa-serial' port='0'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:         <model name='isa-serial'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       </target>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <console type='pty' tty='/dev/pts/2'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <source path='/dev/pts/2'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <log file='/opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881/console.log' append='off'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <target type='serial' port='0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='serial0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </console>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <input type='mouse' bus='ps2'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='input0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <input type='keyboard' bus='ps2'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='input1'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </input>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <graphics type='vnc' port='5902' autoport='yes' listen='0.0.0.0'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <listen type='address' address='0.0.0.0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </graphics>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <audio id='1' type='none'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <model type='virtio' heads='1' primary='yes'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='video0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <memballoon model='virtio' autodeflate='on' freePageReporting='on'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <stats period='10'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='balloon0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <rng model='virtio'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <backend model='random'>/dev/urandom</backend>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <alias name='rng0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <label>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</label>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <imagelabel>libvirt-02578b5c-b022-4d9a-ac22-3552d7e39881</imagelabel>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   <seclabel type='dynamic' model='dac' relabel='yes'>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <label>+64055:+993</label>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:     <imagelabel>+64055:+993</imagelabel>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:   </seclabel>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:30.279690 np0000001388 nova-compute[98319]:  {{(pid=98319) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:276}}
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Detaching interface fa:16:3e:52:57:f7 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap8032f46e-10' not found.
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata=<?>,migration_context=None,new_flavor=None,node='np0000001388',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Converting VIF {"id": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "address": "fa:16:3e:52:57:f7", "network": {"id": "d397f28c-49b6-407d-af36-86d7a61247b1", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1101657737", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8032f46e-10", "ovs_interfaceid": "8032f46e-100c-4ab0-9cfa-a4738ac85112", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:30.279690 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:30.284037 np0000001388 nova-compute[98319]: DEBUG os_vif [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:30.284037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:30.284037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8032f46e-10, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:30.284037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:03:30.284037 np0000001388 nova-compute[98319]: INFO os_vif [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:57:f7,bridge_name='br-int',has_traffic_filtering=True,id=8032f46e-100c-4ab0-9cfa-a4738ac85112,network=Network(d397f28c-49b6-407d-af36-86d7a61247b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8032f46e-10')
May 26 05:03:30.284782 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-156488668', uuid='02578b5c-b022-4d9a-ac22-3552d7e39881'), owner=OwnerMeta(userid='03dbcb5077f54cfb92f9af2ed9e51ba9', username='tempest-TaggedAttachmentsTest-811095965-project-member', projectid='6947ca5ef3684f329c6584405e98f535', projectname='tempest-TaggedAttachmentsTest-811095965'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771810.2843764) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:30.285300 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [req-b8067887-f5b7-4b93-943c-f3e95ee8d6f8 req-68f08e9a-610b-4f6d-91f1-3ea0008c0969 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:package version="33.1.0"/>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:name>tempest-device-tagging-server-156488668</nova:name>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:creationTime>2026-05-26 05:03:30</nova:creationTime>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:flavor name="m1.nano" id="42">
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:memory>192</nova:memory>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:disk>1</nova:disk>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:swap>0</nova:swap>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:vcpus>1</nova:vcpus>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:extraSpecs>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     </nova:extraSpecs>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   </nova:flavor>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:minDisk>1</nova:minDisk>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:minRam>0</nova:minRam>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:properties>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     </nova:properties>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   </nova:image>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:owner>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:user uuid="03dbcb5077f54cfb92f9af2ed9e51ba9">tempest-TaggedAttachmentsTest-811095965-project-member</nova:user>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:project uuid="6947ca5ef3684f329c6584405e98f535">tempest-TaggedAttachmentsTest-811095965</nova:project>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   </nova:owner>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   <nova:ports>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     <nova:port uuid="f2a35255-f23f-4276-bb5a-924ea9ba2cc8">
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:       <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:     </nova:port>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:   </nova:ports>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]: </nova:instance>
May 26 05:03:30.285300 np0000001388 nova-compute[98319]:  {{(pid=98319) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}}
May 26 05:03:30.532443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:30.532719 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:30.652707 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:03:30.665281 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:30.691040 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Took 1.60 seconds to deallocate network for instance.
May 26 05:03:30.779430 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:30.779760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:30.779999 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:30.780150 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:30.780316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:30.780501 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received unexpected event network-vif-unplugged-8032f46e-100c-4ab0-9cfa-a4738ac85112 for instance with vm_state active and task_state None.
May 26 05:03:30.780630 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:30.780781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:30.780928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:30.781039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:30.781154 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:30.782248 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received unexpected event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with vm_state building and task_state spawning.
May 26 05:03:30.782248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:30.782754 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing instance network info cache due to event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:30.783176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:30.833727 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aa7805dd-ab1e-42b6-babc-ea541d7b3c17 req-99b34d7f-4a82-450e-9f9f-57534f6b47fe service nova] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Received event network-vif-deleted-0f10a0b5-86a5-4382-99e5-e170ea108458 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:30.894126 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:31.036029 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:31.050515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:31.050515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:31.050966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:31.051027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:31.051290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:31.062876 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Terminating instance
May 26 05:03:31.066926 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:31.080385 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:31.218472 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [{"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:31.262540 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Took 0.57 seconds to detach 1 volumes for instance.
May 26 05:03:31.266118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Deleting volume: 5af35d79-38f2-4c5a-bfc7-61d05f88f05f {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:03:31.549475 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:03:31.549475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.562s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:31.549919 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.79 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:03:31.583550 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:31.584280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:31.584531 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance network_info: |[{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:03:31.586595 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start _get_guest_xml network_info=[{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:03:31.588652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:31.588930 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:31.594596 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:03:31.595962 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-459121262', uuid='fa807765-450a-493a-b193-fe0d0fcfcb72'), owner=OwnerMeta(userid='fdb1ab2deb1f45f3a5cb5374e0e8dea1', username='tempest-AttachVolumeShelveTestJSON-946543145-project-member', projectid='b6925a7d36eb4b919388468635037918', projectname='tempest-AttachVolumeShelveTestJSON-946543145'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771811.595631) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:31.605027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:03:31.605077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:03:31.607389 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:03:31.607671 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:03:31.609545 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:03:31.609545 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:03:31.609936 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:03:31.609936 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:03:31.610080 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:03:31.610263 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:03:31.610520 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:03:31.610744 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:03:31.611222 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:03:31.611577 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:03:31.611659 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:03:31.614822 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:03:31.630794 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4xxuBfN5XfC8GQ/PmzAL+Sn5BJF4iNyTa2EHq4XkewBnlll0B7YKN7cbLviqRLqEZ7K5GLDh2S5HmHHgPjzj/u68f9SpkPm1a8DM0qrKYGyW50BVrBsiLA3xa1yjRcKQ==',key_name='tempest-keypair-1664079945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:03:31.631046 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:31.634093 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:31.637428 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_devices' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:31.638328 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.647283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.687661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.717967 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.723748 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Releasing lock "refresh_cache-02578b5c-b022-4d9a-ac22-3552d7e39881" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:31.739016 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.743506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:31.743506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:31.743506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No VIF found with MAC fa:16:3e:65:7d:be, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:03:31.744117 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Using config drive
May 26 05:03:31.747335 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.816350 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:31.816350 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:31.876350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.882674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.943458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:31.979828 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.074713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.080864 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.092227 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:32.150851 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] End _get_guest_xml xml=<domain type="qemu">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <uuid>fa807765-450a-493a-b193-fe0d0fcfcb72</uuid>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <name>instance-0000001b</name>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-459121262</nova:name>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:03:31</nova:creationTime>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:user uuid="fdb1ab2deb1f45f3a5cb5374e0e8dea1">tempest-AttachVolumeShelveTestJSON-946543145-project-member</nova:user>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:project uuid="b6925a7d36eb4b919388468635037918">tempest-AttachVolumeShelveTestJSON-946543145</nova:project>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         <nova:port uuid="b7ee8de7-e65c-4b0f-b64a-2af100a06510">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <system>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="serial">fa807765-450a-493a-b193-fe0d0fcfcb72</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="uuid">fa807765-450a-493a-b193-fe0d0fcfcb72</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </system>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <os>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </os>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <features>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </features>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   <devices>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </disk>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b8:9a:c3"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <target dev="tapb7ee8de7-e6"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </interface>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/console.log" append="off"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </serial>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <video>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </video>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </rng>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:   </devices>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]: </domain>
May 26 05:03:32.150851 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:03:32.154867 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Preparing to wait for external event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:03:32.154867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.154867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.154867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.159347 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4xxuBfN5XfC8GQ/PmzAL+Sn5BJF4iNyTa2EHq4XkewBnlll0B7YKN7cbLviqRLqEZ7K5GLDh2S5HmHHgPjzj/u68f9SpkPm1a8DM0qrKYGyW50BVrBsiLA3xa1yjRcKQ==',key_name='tempest-keypair-1664079945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:03:32.159642 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:32.160807 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:32.161566 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:03:32.162035 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.162363 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.162600 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:03:32.167257 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.167403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faf29fba-064b-59f8-83b3-2ceccb4a1b0c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.169164 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.170154 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:32.213711 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.232057 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b38a19c6-77de-4408-82b4-37639c1d8b8d tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "interface-02578b5c-b022-4d9a-ac22-3552d7e39881-8032f46e-100c-4ab0-9cfa-a4738ac85112" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 6.456s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.254187 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:32.266456 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.268098 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.288500 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.288739 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ee8de7-e6, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.294468 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ee8de7-e6, col_values=(('qos', UUID('919acd47-e6ea-48b8-ba25-445e333fda06')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.295046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ee8de7-e6, col_values=(('external_ids', {'iface-id': 'b7ee8de7-e65c-4b0f-b64a-2af100a06510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:9a:c3', 'vm-uuid': 'fa807765-450a-493a-b193-fe0d0fcfcb72'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.300864 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:32.336555 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.340559 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999622440000167 future=<Future at 0x7d7aa4400e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:32.344033 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Instance destroyed successfully.
May 26 05:03:32.344919 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lazy-loading 'resources' on Instance uuid 1d1d5287-dc50-4416-8e04-5f6cc47747ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:32.348807 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:03:32.355657 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.26 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:03:32.392064 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.397041 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.398788 np0000001388 nova-compute[98319]: INFO os_vif [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6')
May 26 05:03:32.402762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.402762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.402762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.403115 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.403115 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bb69c452-d986-40e1-948e-2cb48eda7e43 req-f81f5a43-912c-4c09-998f-a5ff51ae3b7a service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.550539 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Creating config drive at /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.config
May 26 05:03:32.565393 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0p14oo2f {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:32.567051 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:32.567051 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:32.630262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0p14oo2f" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:32.792627 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:32.859084 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:32.859510 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:32.860129 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:32.860381 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:32.864795 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.866234 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa183d9a1-bb, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.867357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.868334 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:32.888455 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.889168 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.889168 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.889168 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.889168 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-a183d9a1-bb48-426b-8663-8113a1e6df94 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.891788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.894170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.894170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.894170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.894170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.894170 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.894866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.897038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.898333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.898333 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.898333 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-32ca7d69-1481-4c9a-abbb-48df1da7097d req-8c3c12f4-9557-499f-8c01-79db84975655 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ab88d52b-7850-42b4-9af0-733bf16b3461 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.926677 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.926837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.927457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.927457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.927457 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.927669 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.927669 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-bfe036f8-08bb-4b85-b78e-28e8b76d4ff5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.929954 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.930213 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.930448 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.930964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.931305 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.931475 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.931475 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:32.931731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:32.932618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:32.932618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:32.936803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.938688 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:32.938688 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eb3f8968-0851-4298-a9dd-08d447e717e6 req-791c9692-5fd6-4df4-b871-b740e3f82b46 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e93d6144-2bb7-4826-b780-4de24fb838f7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:32.943256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.943638 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e571c446-f421-46b4-8b44-074e3eeafa9a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:32.946964 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:32.947481 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.009774 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.021582 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:ab:41,bridge_name='br-int',has_traffic_filtering=True,id=a183d9a1-bb48-426b-8663-8113a1e6df94,network=Network(3be488e1-9263-410b-94a8-b3d509bab0dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa183d9a1-bb')
May 26 05:03:33.022523 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.023343 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.024043 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.024344 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.025231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.027983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfe036f8-08, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.027983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.028103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.073057 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updated VIF entry in instance network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:03:33.074535 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:33.075574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.079583 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.079958 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5681e837-febf-4631-af65-eeba73fa0b9a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.082273 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:33.088819 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.094711 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.138574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.141146 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:6e:53,bridge_name='br-int',has_traffic_filtering=True,id=bfe036f8-08bb-4b85-b78e-28e8b76d4ff5,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbfe036f8-08')
May 26 05:03:33.141880 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.142052 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.142617 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.143094 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.143789 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.143960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab88d52b-78, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.147160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.148254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.184829 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.186022 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.186254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26c5fdc7-7133-4c91-9e93-5f3cc4ee56bc) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.187322 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.187859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.225273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.227889 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:df:18,bridge_name='br-int',has_traffic_filtering=True,id=ab88d52b-7850-42b4-9af0-733bf16b3461,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab88d52b-78')
May 26 05:03:33.230907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.231268 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.231782 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.232011 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.232957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.233055 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba67c92e-9f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.234460 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.236160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.258998 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.304136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.306098 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.306949 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d4c1f07-83e1-429f-91ed-b2dce22441dd) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.307941 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.310414 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.357218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.358494 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.363255 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:3f:86,bridge_name='br-int',has_traffic_filtering=True,id=ba67c92e-9ff7-41fa-9a12-c8043357b83b,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba67c92e-9f')
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.366873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape93d6144-2b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.367378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.368578 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.411372 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.412441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.412626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd3434dc-838a-49bd-9b39-f735e92b478d) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.413251 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.414329 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.431981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.436250 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:9b:7d,bridge_name='br-int',has_traffic_filtering=True,id=e93d6144-2bb7-4826-b780-4de24fb838f7,network=Network(01ce7dee-1111-4a1a-a951-bfca6ef60092),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape93d6144-2b')
May 26 05:03:33.436775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.436977 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "76837440-e063-400b-9639-ffafb76b64bd", "address": "fa:16:3e:57:42:de", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap76837440-e0", "ovs_interfaceid": "76837440-e063-400b-9639-ffafb76b64bd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.437674 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.437917 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.442006 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.442290 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76837440-e0, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.444016 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.445960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.464764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.465653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.465869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e66018e-f108-4c7a-a336-25a0ff43cb52) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.466442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.467096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.496501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.501240 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:42:de,bridge_name='br-int',has_traffic_filtering=True,id=76837440-e063-400b-9639-ffafb76b64bd,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76837440-e0')
May 26 05:03:33.501240 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-538963615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-538963615',id=21,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDqupqS32ebE5KTjHDS4smP4RIb1owX6TtwMtUmkAeLpHD4UEzeZ9AIesveU+Juwr64d6pa9Oav1QTICcMwSyI4nSd9xaU6+783rVwV17sd9JVAow8NFMrRwMJUQTk2PGQ==',key_name='tempest-keypair-674332498',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba1a070782e1452690c54eb9a95cb8d3',ramdisk_id='',reservation_id='r-x9kfkzsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15632634',owner_user_name='tempest-TaggedBootDevicesTest_v242-15632634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37820297b6154d5cab2a158004754721',uuid=1d1d5287-dc50-4416-8e04-5f6cc47747ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:33.502166 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converting VIF {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:33.508739 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:33.509307 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:33.510313 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.510520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape945b3df-40, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.513594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.513922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.519206 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.520189 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.520383 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=054c7b9a-e8de-4e16-be34-61c3123c053c) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:33.521544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.523382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:33.528824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.534543 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:6a:9c,bridge_name='br-int',has_traffic_filtering=True,id=e945b3df-400c-4c78-a398-1e41795b4479,network=Network(2e411522-7b9a-4966-8d89-c3afeac3834a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape945b3df-40')
May 26 05:03:33.544291 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:33.544793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:33.544793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:33.545315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:33.546142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:33.546142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:33.583503 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [48] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:33.584766 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa', '68')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:33.584766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '47')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:33.586020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9', '48')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:33.587668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4440360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:33.588649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Removing multipathed devices sdi, sdb {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:33.588649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Flush multipath device 3300000007138490c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:33.594860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-870ac004-21d5-4465-ba2d-e218c8800098 req-7dea41e1-59c7-40ac-9c64-7472cddfffc8 service nova] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:33.604845 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.788s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:33.649755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:33.702179 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:33.712396 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Deleted allocations for instance ec4ecad1-7f2e-4026-b3c5-be40769b3a19
May 26 05:03:33.720063 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.733726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.734332 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.761441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if SCSI volumes sdi, sdb have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:33.761775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] SCSI volumes sdi, sdb have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:33.764611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if device paths {'sdi', 'sdb'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:33.777605 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.781579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:33.782107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:33.782107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:33.782336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:33.782336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:33.784444 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:33.785569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Device paths {'sdi', 'sdb'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:33.785891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:33.788940 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Terminating instance
May 26 05:03:33.803719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.849083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.40.100,3260]
May 26 05:03:33.849083 np0000001388 nova-compute[98319]: Logout of [sid: 47, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.40.100,3260] successful.
May 26 05:03:33.849083 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.874959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.891702 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.933716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.50.100,3260]
May 26 05:03:33.933716 np0000001388 nova-compute[98319]: Logout of [sid: 48, target: iqn.2023-03.storpool.com:os--volume-7ec8dd0f-0f02-43c8-9519-11307e31b4b9, portal: 192.168.50.100,3260] successful.
May 26 05:03:33.933716 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.951115 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:33.951284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:03:33.951484 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No VIF found with MAC fa:16:3e:b8:9a:c3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:03:33.952124 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Using config drive
May 26 05:03:33.953986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:33.954462 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.409s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:33.954614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== disconnect_volume: return (409ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:33.954780 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:33.956444 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:33.956730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:33.956833 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:33.957120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:33.957501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '154572d8-867e-4056-bf4e-d87fcb2cacd8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:33.957647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [50] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [51] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:33.993756 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:33.993756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa', '68')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:33.996143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '50')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:33.997289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8', '51')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:33.999341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43e2340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'): ({'sdl'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:33.999341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Removing multipathed devices sdl, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:33.999341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Flush multipath device 3300000004c1c5633 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:34.034713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:34.077883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:34.132217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if SCSI volumes sdl, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:34.132501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] SCSI volumes sdl, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:34.134238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if device paths {'sdl', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:34.151079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Device paths {'sdl', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:34.151329 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:34.167860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.208092 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.40.100,3260]
May 26 05:03:34.208092 np0000001388 nova-compute[98319]: Logout of [sid: 50, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.40.100,3260] successful.
May 26 05:03:34.208092 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.237898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.253069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.286981 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.50.100,3260]
May 26 05:03:34.286981 np0000001388 nova-compute[98319]: Logout of [sid: 51, target: iqn.2023-03.storpool.com:os--volume-154572d8-867e-4056-bf4e-d87fcb2cacd8, portal: 192.168.50.100,3260] successful.
May 26 05:03:34.286981 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.296992 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:34.310111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.311222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:34.311222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== disconnect_volume: return (354ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:34.311222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:34.313501 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:34.313501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:34.313501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:34.313728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:34.314181 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9fac7c50-4cb1-491c-b359-35726050ee98', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:34.314625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:34.338272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:34.342882 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsi session list stdout=tcp: [54] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [55] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [66] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [67] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6 (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: tcp: [68] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa (non-flash)
May 26 05:03:34.358133 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '66'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-271ce910-9dc4-4dc2-bdec-d8e93aa6baa6', '67'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-791f81b5-d802-4ac2-bb1e-ee62afb130fa', '68')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:34.358133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '54')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:34.362706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98', '55')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:34.362706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4590e00>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'): ({'sdm'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'): ({'sdn'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:34.362706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Removing multipathed devices sdn, sdm {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:34.362706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Flush multipath device 3300000003b14a1fc {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:34.369274 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:34.373186 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:34.414794 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771814.4122758, 477377b6-cc48-467a-a9a6-d7f2c7be8743 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:34.414794 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] VM Started (Lifecycle Event)
May 26 05:03:34.426059 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:34.427215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:34.460956 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:34.471283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:34.506897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:34.507621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:34.508316 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:34.508607 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:34.509899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:34.510071 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-76837440-e063-400b-9639-ffafb76b64bd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:34.510222 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:34.510488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:34.510609 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:34.510794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:34.510848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Processing event network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:03:34.511061 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:34.511423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:34.512362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:34.512860 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:03:34.513278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:34.513544 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] No waiting events found dispatching network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:34.513755 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8ec6675b-8ded-4321-9004-94a239524762 req-7b7b7319-012c-495a-8ea8-9900f78d94ea service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received unexpected event network-vif-plugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 for instance with vm_state building and task_state spawning.
May 26 05:03:34.521008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if SCSI volumes sdn, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:34.521008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] SCSI volumes sdn, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:34.521796 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:03:34.528221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Checking to see if device paths {'sdn', 'sdm'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:34.532982 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance spawned successfully.
May 26 05:03:34.533325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:03:34.545004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Device paths {'sdn', 'sdm'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:34.545485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:34.564410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.625301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.40.100,3260]
May 26 05:03:34.625301 np0000001388 nova-compute[98319]: Logout of [sid: 54, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.40.100,3260] successful.
May 26 05:03:34.625301 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.645793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.664261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.671955 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Instance destroyed successfully.
May 26 05:03:34.673022 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lazy-loading 'resources' on Instance uuid 02578b5c-b022-4d9a-ac22-3552d7e39881 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:34.706277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.50.100,3260]
May 26 05:03:34.706277 np0000001388 nova-compute[98319]: Logout of [sid: 55, target: iqn.2023-03.storpool.com:os--volume-9fac7c50-4cb1-491c-b359-35726050ee98, portal: 192.168.50.100,3260] successful.
May 26 05:03:34.706277 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.722329 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating config drive at /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config
May 26 05:03:34.727171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2a0d248-8b97-4740-a327-e2225245880c tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "ec4ecad1-7f2e-4026-b3c5-be40769b3a19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.104s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:34.731920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:34.732237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:34.732889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] <== disconnect_volume: return (418ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:34.732986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:34.733325 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Deleting instance files /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea_del
May 26 05:03:34.734556 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Deletion of /opt/stack/data/nova/instances/1d1d5287-dc50-4416-8e04-5f6cc47747ea_del complete
May 26 05:03:34.742161 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7a2qt_rq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:34.817565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7a2qt_rq" returned: 0 in 0.075s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:34.926605 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:34.930896 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:03:34.999257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.000823 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.001126 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.004220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8925352e-55e6-4a50-80f8-e7af4671de05 req-521c7157-5b4a-4814-8872-bdb1d6dcf178 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-ba67c92e-9ff7-41fa-9a12-c8043357b83b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.033782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.035743 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.036369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.036369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.036369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.036556 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.038391 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.044427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Acquiring lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.044427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.044427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.044656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] No waiting events found dispatching network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.045328 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-unplugged-e945b3df-400c-4c78-a398-1e41795b4479 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.046590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.046918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.047370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.047636 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.047888 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.048114 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.048308 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:35.048644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Acquiring lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:35.048986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:35.049650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:35.049650 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] No waiting events found dispatching network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:35.049650 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8d1dea44-ea4a-4a7a-9dd0-6108bb87754c req-4321fa00-421c-4622-84f1-e30ec8a529ee service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-unplugged-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:35.054944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.056373 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.057363 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.060469 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.061039 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.061852 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:35.181668 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:02:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-156488668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-device-tagging-server-156488668',id=25,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHSE8iMjXyUbu4Tnu7iKrlZb+BMaMjSXGn7Rh7Z7XKdYqXIpo44a6vU6V/GupIB5a7rVDAi0twr80ge83An1ZzQzfBmZSAODj/yLO1PRumG+aWE9uZjkCZtZKFumm3eXA==',key_name='tempest-keypair-84079697',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:19Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6947ca5ef3684f329c6584405e98f535',ramdisk_id='',reservation_id='r-aj3idayt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-811095965',owner_user_name='tempest-TaggedAttachmentsTest-811095965-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='03dbcb5077f54cfb92f9af2ed9e51ba9',uuid=02578b5c-b022-4d9a-ac22-3552d7e39881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:35.181976 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converting VIF {"id": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "address": "fa:16:3e:68:cb:88", "network": {"id": "95403af5-b78b-430d-b709-5c512b066797", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1848468455-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "6947ca5ef3684f329c6584405e98f535", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a35255-f2", "ovs_interfaceid": "f2a35255-f23f-4276-bb5a-924ea9ba2cc8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:35.182921 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:35.183640 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:35.185486 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.186166 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2a35255-f2, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:35.190127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.191374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:35.197479 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.202601 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.202882 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b48c6d8f-38ce-4702-a2ff-aa6786534012) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:35.204289 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.225298 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:35.230325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.234954 np0000001388 nova-compute[98319]: INFO os_vif [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:cb:88,bridge_name='br-int',has_traffic_filtering=True,id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8,network=Network(95403af5-b78b-430d-b709-5c512b066797),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a35255-f2')
May 26 05:03:35.235620 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Deleting instance files /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881_del
May 26 05:03:35.237439 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Deletion of /opt/stack/data/nova/instances/02578b5c-b022-4d9a-ac22-3552d7e39881_del complete
May 26 05:03:35.253577 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Took 3.67 seconds to destroy the instance on the hypervisor.
May 26 05:03:35.254268 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:35.255223 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:35.255223 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:35.255223 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:35.386126 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:35.436086 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:03:35.436086 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771815.43585, 477377b6-cc48-467a-a9a6-d7f2c7be8743 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:35.436646 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] VM Paused (Lifecycle Event)
May 26 05:03:35.443680 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.474676 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.568073 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Took 8.58 seconds to spawn the instance on the hypervisor.
May 26 05:03:35.568929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:35.595592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:35.751831 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Took 1.45 seconds to destroy the instance on the hypervisor.
May 26 05:03:35.753085 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:35.756905 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:35.756905 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:35.756905 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:35.916751 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:35.942232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:35.951345 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771815.9490812, 477377b6-cc48-467a-a9a6-d7f2c7be8743 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:35.951669 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] VM Resumed (Lifecycle Event)
May 26 05:03:36.021383 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:36.025995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:36.029956 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:36.062015 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:36.079266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Took 14.32 seconds to build instance.
May 26 05:03:36.454715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:36.459134 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:03:36.583399 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-52ae4898-1ad2-4074-a149-f847c8405ab9 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.836s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:36.752547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:36.752948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:36.753344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:36.753709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:36.753915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:36.756443 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Terminating instance
May 26 05:03:36.971805 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999699032999615 future=<Future at 0x7d7aa44b95e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:36.972248 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771816.9718494, fa807765-450a-493a-b193-fe0d0fcfcb72 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:36.972248 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Started (Lifecycle Event)
May 26 05:03:37.013072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.106480 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:37.107409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:37.107409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:37.108496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:37.108496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Processing event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:03:37.108496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:37.108496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:37.108660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:37.108660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:37.108927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:37.109143 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received unexpected event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with vm_state building and task_state spawning.
May 26 05:03:37.109507 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Received event network-vif-deleted-f2a35255-f23f-4276-bb5a-924ea9ba2cc8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:37.109838 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Neutron deleted interface f2a35255-f23f-4276-bb5a-924ea9ba2cc8; detaching it from the instance and deleting it from the info cache
May 26 05:03:37.109974 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:37.112097 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:03:37.112097 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:37.116836 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:03:37.132726 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance spawned successfully.
May 26 05:03:37.134070 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:03:37.214507 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.263554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:37.294904 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.298904 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.331617 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.364271 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:37.475161 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:37.484405 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:03:37.622077 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Took 1.86 seconds to deallocate network for instance.
May 26 05:03:37.632250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64de9de2-4185-4819-b965-cc4c80ec6570 req-2b917d08-7cfd-4dc5-8fc2-c09fde196a8f service nova] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Detach interface failed, port_id=f2a35255-f23f-4276-bb5a-924ea9ba2cc8, reason: Instance 02578b5c-b022-4d9a-ac22-3552d7e39881 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:37.651540 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Instance destroyed successfully.
May 26 05:03:37.653126 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lazy-loading 'resources' on Instance uuid f40c13f1-a910-4f6a-b000-2baa84ce86fa {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:37.657741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.657979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.658486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.658840 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.659472 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.660082 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:03:37.839354 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fcc6bda5-63ff-4cb9-bdb9-320f6d6271cd req-41665242-3629-4286-b7aa-729140632a67 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-deleted-76837440-e063-400b-9639-ffafb76b64bd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:37.839354 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-fcc6bda5-63ff-4cb9-bdb9-320f6d6271cd req-41665242-3629-4286-b7aa-729140632a67 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Neutron deleted interface 76837440-e063-400b-9639-ffafb76b64bd; detaching it from the instance and deleting it from the info cache
May 26 05:03:37.839870 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-fcc6bda5-63ff-4cb9-bdb9-320f6d6271cd req-41665242-3629-4286-b7aa-729140632a67 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e945b3df-400c-4c78-a398-1e41795b4479", "address": "fa:16:3e:91:6a:9c", "network": {"id": "2e411522-7b9a-4966-8d89-c3afeac3834a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1730850336", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape945b3df-40", "ovs_interfaceid": "e945b3df-400c-4c78-a398-1e41795b4479", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:37.989858 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:03:37.990500 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771817.9898949, fa807765-450a-493a-b193-fe0d0fcfcb72 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:37.990500 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Paused (Lifecycle Event)
May 26 05:03:38.137982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:38.139228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:38.156185 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T04:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-653117587',display_name='tempest-ServerActionsTestOtherA-server-653117587',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionstestothera-server-653117587',id=9,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAA/ZoQ3pQ2b+BW97jXUXgY3gW6q7sPtrDrqnJcGw0CX1xlrlld+xpHElHHP+ZxIiySlv9OTO/mZdc6Ji30mQSEawBJyBdRb56NKjEMugUmvhhkuHc/4BhKNpRjneDMIBg==',key_name='tempest-keypair-1890896402',keypairs=<?>,launch_index=0,launched_at=2026-05-26T04:58:46Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='278ea77812db4e90a14904f104739285',ramdisk_id='',reservation_id='r-s9a4yv8i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-846952046',owner_user_name='tempest-ServerActionsTestOtherA-846952046-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T04:58:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e78b48c4b4dc439086e392b4800b4ad7',uuid=f40c13f1-a910-4f6a-b000-2baa84ce86fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:38.156185 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converting VIF {"id": "daeb843a-0159-409b-8390-b08c56ae2515", "address": "fa:16:3e:fa:7f:17", "network": {"id": "084b201f-6c9f-46a8-9989-9c4841a42c4a", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-668956757-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "278ea77812db4e90a14904f104739285", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaeb843a-01", "ovs_interfaceid": "daeb843a-0159-409b-8390-b08c56ae2515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:38.157344 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:38.157344 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:38.158279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:38.158467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaeb843a-01, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:38.159885 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:38.160777 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:38.161832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:38.162974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:38.163116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3b35b3cc-cde6-46b6-a6df-a6c9442be697) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:38.165401 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:38.168655 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:38.180020 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Took 8.58 seconds to spawn the instance on the hypervisor.
May 26 05:03:38.181266 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:38.185354 np0000001388 nova-compute[98319]: INFO os_vif [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:7f:17,bridge_name='br-int',has_traffic_filtering=True,id=daeb843a-0159-409b-8390-b08c56ae2515,network=Network(084b201f-6c9f-46a8-9989-9c4841a42c4a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaeb843a-01')
May 26 05:03:38.191399 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Deleting instance files /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa_del
May 26 05:03:38.194879 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Deletion of /opt/stack/data/nova/instances/f40c13f1-a910-4f6a-b000-2baa84ce86fa_del complete
May 26 05:03:38.350623 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fcc6bda5-63ff-4cb9-bdb9-320f6d6271cd req-41665242-3629-4286-b7aa-729140632a67 service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Detach interface failed, port_id=76837440-e063-400b-9639-ffafb76b64bd, reason: Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:38.497042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:38.501655 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771818.4987059, fa807765-450a-493a-b193-fe0d0fcfcb72 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:38.501655 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Resumed (Lifecycle Event)
May 26 05:03:38.551948 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-changed-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:38.552008 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Refreshing instance network info cache due to event network-changed-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:38.552187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] Acquiring lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:38.552416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] Acquired lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:38.552554 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Refreshing network info cache for port d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:38.699379 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Took 15.48 seconds to build instance.
May 26 05:03:38.705037 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Took 1.44 seconds to destroy the instance on the hypervisor.
May 26 05:03:38.708768 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:38.708768 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:38.712371 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:38.712371 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:38.733357 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:38.733694 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:38.849034 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:39.014444 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:39.022241 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:03:39.063785 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:39.202869 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.991s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:39.212720 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-deleted-e945b3df-400c-4c78-a398-1e41795b4479 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:39.213424 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Neutron deleted interface e945b3df-400c-4c78-a398-1e41795b4479; detaching it from the instance and deleting it from the info cache
May 26 05:03:39.213424 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e93d6144-2bb7-4826-b780-4de24fb838f7", "address": "fa:16:3e:90:9b:7d", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape93d6144-2b", "ovs_interfaceid": "e93d6144-2bb7-4826-b780-4de24fb838f7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:39.236990 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:39.528786 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999619583999902 future=<Future at 0x7d7ae410b4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:39.582945 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:39.705652 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:39.726157 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Detach interface failed, port_id=e945b3df-400c-4c78-a398-1e41795b4479, reason: Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:39.726157 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:39.726157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:39.726157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:39.726157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] No waiting events found dispatching network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Acquiring lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] No waiting events found dispatching network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-unplugged-daeb843a-0159-409b-8390-b08c56ae2515 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-deleted-e93d6144-2bb7-4826-b780-4de24fb838f7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Neutron deleted interface e93d6144-2bb7-4826-b780-4de24fb838f7; detaching it from the instance and deleting it from the info cache
May 26 05:03:39.733819 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "a183d9a1-bb48-426b-8663-8113a1e6df94", "address": "fa:16:3e:b3:ab:41", "network": {"id": "3be488e1-9263-410b-94a8-b3d509bab0dc", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1110381390-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa183d9a1-bb", "ovs_interfaceid": "a183d9a1-bb48-426b-8663-8113a1e6df94", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:39.746939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.608s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:39.778461 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updated VIF entry in instance network info cache for port d1cd2bd8-9a23-4af8-8c22-084c4b0d5850. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:03:39.778841 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating instance_info_cache with network_info: [{"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:39.828595 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:39.829937 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Deleted allocations for instance 02578b5c-b022-4d9a-ac22-3552d7e39881
May 26 05:03:39.935048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-341c5d94-1880-4776-9d42-6249eb915eeb req-e8b5f2af-5e39-4d54-bea6-1bed161a63c8 service nova] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Received event network-vif-deleted-daeb843a-0159-409b-8390-b08c56ae2515 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:40.212063 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Took 1.50 seconds to deallocate network for instance.
May 26 05:03:40.248881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Detach interface failed, port_id=e93d6144-2bb7-4826-b780-4de24fb838f7, reason: Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:40.248881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-deleted-a183d9a1-bb48-426b-8663-8113a1e6df94 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:40.248881 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Neutron deleted interface a183d9a1-bb48-426b-8663-8113a1e6df94; detaching it from the instance and deleting it from the info cache
May 26 05:03:40.248881 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "address": "fa:16:3e:ec:3f:86", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.85", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapba67c92e-9f", "ovs_interfaceid": "ba67c92e-9ff7-41fa-9a12-c8043357b83b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:40.283547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4163723c-71ef-4ac7-aa42-c9936d1d5d35 req-0074bcf8-821c-4eb8-8b57-6a357a6e31ac service nova] Releasing lock "refresh_cache-477377b6-cc48-467a-a9a6-d7f2c7be8743" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:40.340694 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Took 5.09 seconds to deallocate network for instance.
May 26 05:03:40.653188 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f2c4f579-601b-402f-945d-96fc5ecb19c2 req-56adad66-bb33-428b-a513-180ffb27038b service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Received event network-vif-deleted-ba67c92e-9ff7-41fa-9a12-c8043357b83b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:40.653569 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-f2c4f579-601b-402f-945d-96fc5ecb19c2 req-56adad66-bb33-428b-a513-180ffb27038b service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Neutron deleted interface ba67c92e-9ff7-41fa-9a12-c8043357b83b; detaching it from the instance and deleting it from the info cache
May 26 05:03:40.653985 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f2c4f579-601b-402f-945d-96fc5ecb19c2 req-56adad66-bb33-428b-a513-180ffb27038b service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Updating instance_info_cache with network_info: [{"id": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "address": "fa:16:3e:dc:6e:53", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfe036f8-08", "ovs_interfaceid": "bfe036f8-08bb-4b85-b78e-28e8b76d4ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ab88d52b-7850-42b4-9af0-733bf16b3461", "address": "fa:16:3e:cf:df:18", "network": {"id": "01ce7dee-1111-4a1a-a951-bfca6ef60092", "bridge": "br-int", "label": "tempest-device-tagging-net1-428234247", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.61", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ba1a070782e1452690c54eb9a95cb8d3", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapab88d52b-78", "ovs_interfaceid": "ab88d52b-7850-42b4-9af0-733bf16b3461", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:40.719571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:40.719799 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:40.753928 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9550b334-5a92-4707-862f-0043d1b0fc4f req-62cb0c8d-7570-451a-a5ca-45f79e707fdd service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Detach interface failed, port_id=a183d9a1-bb48-426b-8663-8113a1e6df94, reason: Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:40.845044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d221d3b-a625-4a90-840c-dd42cdcdf396 tempest-TaggedAttachmentsTest-811095965 tempest-TaggedAttachmentsTest-811095965-project-member] Lock "02578b5c-b022-4d9a-ac22-3552d7e39881" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.063s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:41.093569 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:41.093569 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:41.159795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f2c4f579-601b-402f-945d-96fc5ecb19c2 req-56adad66-bb33-428b-a513-180ffb27038b service nova] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Detach interface failed, port_id=ba67c92e-9ff7-41fa-9a12-c8043357b83b, reason: Instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:41.600647 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:41.881010 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:03:42.031654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:42.031832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing instance network info cache due to event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:42.032083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:42.032083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:42.032324 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:42.062442 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Took 1.72 seconds to detach 3 volumes for instance.
May 26 05:03:42.110805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.391s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:42.129918 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:42.170492 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Deleted allocations for instance f40c13f1-a910-4f6a-b000-2baa84ce86fa
May 26 05:03:42.522025 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005048989996794262 future=<Future at 0x7d7ac4111670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:42.522913 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] Emitting event <LifecycleEvent: 1779771807.5211854, ec4ecad1-7f2e-4026-b3c5-be40769b3a19 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:42.522913 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:42.523272 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] VM Stopped (Lifecycle Event)
May 26 05:03:42.523388 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.8167536690002635 future=<Future at 0x7d7aa4400e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:42.523554 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.8165931120001915 future=<Future at 0x7d7aa4400e90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:42.535988 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:42.572130 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:42.572400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:42.961933 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:42.962645 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:43.011620 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:43.030372 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d47f737a-4d3f-4a6f-8181-d1f877ceb8a4 tempest-TestVolumeBackupRestore-2077017730 tempest-TestVolumeBackupRestore-2077017730-project-member] [instance: ec4ecad1-7f2e-4026-b3c5-be40769b3a19] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:43.167168 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:43.182903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8867a64e-1f33-443d-944c-fb1075122149 tempest-ServerActionsTestOtherA-846952046 tempest-ServerActionsTestOtherA-846952046-project-member] Lock "f40c13f1-a910-4f6a-b000-2baa84ce86fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.430s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:43.228499 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updated VIF entry in instance network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:03:43.230242 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:43.468375 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:43.731997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9c60bcc8-ced3-4be0-880a-e4833a4e9423 req-50a295b8-d042-49a4-bd58-b027220905d2 service nova] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:43.977760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.405s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:44.082911 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Deleted allocations for instance 1d1d5287-dc50-4416-8e04-5f6cc47747ea
May 26 05:03:44.935545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:44.935745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:45.096192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0a95cda-4680-47e0-a60e-3c66ac0063da tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Lock "1d1d5287-dc50-4416-8e04-5f6cc47747ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.046s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:45.438026 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:03:45.648346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:45.705289 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:46.023574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:46.023822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:46.029443 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:03:46.029774 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Claim successful on node np0000001388
May 26 05:03:47.131772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:47.341425 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0012299479999455798 future=<Future at 0x7d7aa4400e90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:47.341850 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:47.343297 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] Emitting event <LifecycleEvent: 1779771812.340062, 1d1d5287-dc50-4416-8e04-5f6cc47747ea => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:47.343484 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] VM Stopped (Lifecycle Event)
May 26 05:03:47.344468 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.627015037999627 future=<Future at 0x7d7aa44b95e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:47.344969 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.626660270999764 future=<Future at 0x7d7aa44b95e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:47.364679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:47.367225 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:47.791167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:47.791462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:47.846757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7bf02a11-5bbb-4abd-9256-2aaa25031369 tempest-VolumesActionsTest-320780185 tempest-VolumesActionsTest-320780185-project-member] [instance: 1d1d5287-dc50-4416-8e04-5f6cc47747ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:47.870224 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:48.169264 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:48.294636 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Detaching volume 9f82887e-46e7-427e-8375-cb30bcfbc7c7
May 26 05:03:48.316730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:48.355912 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Attempting to driver detach volume 9f82887e-46e7-427e-8375-cb30bcfbc7c7 from mountpoint /dev/vdb
May 26 05:03:48.359347 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found disk vdb by alias ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:03:48.360849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found disk vdb by alias ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:03:48.361068 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Attempting to detach device vdb from instance 71b40a96-611b-4143-a895-e464b0ce391d from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:03:48.361516 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <alias name="ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7"/>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <serial>9f82887e-46e7-427e-8375-cb30bcfbc7c7</serial>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:48.361516 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:48.371468 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully detached device vdb from instance 71b40a96-611b-4143-a895-e464b0ce391d from the persistent domain config.
May 26 05:03:48.372127 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] (1/8): Attempting to detach device vdb with device alias ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7 from instance 71b40a96-611b-4143-a895-e464b0ce391d from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:03:48.372466 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <alias name="ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7"/>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <serial>9f82887e-46e7-427e-8375-cb30bcfbc7c7</serial>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]: </disk>
May 26 05:03:48.372466 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:03:48.381952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.358s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:48.382515 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:03:48.890310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:03:48.894693 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:03:48.894693 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:48.894693 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:49.011837 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '34b4ac452e8c430695b189e1083a0c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21271255e15b4780a232d67028f62d32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:03:49.014991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771829.014708, 71b40a96-611b-4143-a895-e464b0ce391d => ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:03:49.015666 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-9f82887e-46e7-427e-8375-cb30bcfbc7c7 for instance 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:03:49.020553 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully detached device vdb from instance 71b40a96-611b-4143-a895-e464b0ce391d from the live domain config.
May 26 05:03:49.022219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:03:49.022219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:49.022416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:49.024841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:49.024841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9f82887e-46e7-427e-8375-cb30bcfbc7c7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:03:49.024841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:03:49.055157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:49.055157 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:49.055157 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:49.055157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [64] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:49.055157 np0000001388 nova-compute[98319]: tcp: [65] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7 (non-flash)
May 26 05:03:49.055157 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:49.055943 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:03:49.055943 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '64')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:49.056958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7', '65')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:03:49.058071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46cae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:03:49.058316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Removing multipathed devices sde, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:03:49.062325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flush multipath device 330000000e910d809 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:03:49.098749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:49.144779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:03:49.192644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:03:49.193004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:03:49.193805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:03:49.208925 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:03:49.209163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:03:49.223835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.261424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 64, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.40.100,3260]
May 26 05:03:49.261424 np0000001388 nova-compute[98319]: Logout of [sid: 64, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.40.100,3260] successful.
May 26 05:03:49.261424 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.273881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.288359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.316296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 65, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.50.100,3260]
May 26 05:03:49.316296 np0000001388 nova-compute[98319]: Logout of [sid: 65, target: iqn.2023-03.storpool.com:os--volume-9f82887e-46e7-427e-8375-cb30bcfbc7c7, portal: 192.168.50.100,3260] successful.
May 26 05:03:49.316296 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.331993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:49.332317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:49.332517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== disconnect_volume: return (309ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:49.332679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:03:49.393184 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:03:49.763462 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Successfully created port: 0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:03:49.908709 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:50.344137 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Successfully updated port: 0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:03:50.400999 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:03:50.424658 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-changed-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:50.424658 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Refreshing instance network info cache due to event network-changed-0959a8ad-26da-4a87-9979-27832a4913eb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:03:50.425797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] Acquiring lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:50.425976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] Acquired lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:50.426182 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Refreshing network info cache for port 0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:03:50.713116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:50.849015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:03:50.907252 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Booting with volume 7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 at /dev/vdb
May 26 05:03:50.920765 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25ebc1ca-1f8b-46fd-bcbb-e3f4fc67ad45 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.129s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:50.929999 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:50.972555 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:50.989101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:03:51.014171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:51.079413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:03:51.079413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:03:51.079413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:03:51.080779 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fefc:c9eb', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fe65:7dbe', 'fe80::4cc9:2fff:fe63:6c1', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d'] 
May 26 05:03:51.081151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:03:51.081151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:03:51.083460 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:51.083460 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updating existing volume attachment record: 7cb37639-dad9-4cf4-9993-8ed0351ac14e {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:03:51.113419 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:03:51.122292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:51.122632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:51.122855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:51.123157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:51.123157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:51.129854 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Terminating instance
May 26 05:03:51.634574 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:03:51.648751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.654281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.675480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.688252 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.710624 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.716356 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:51.838910 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:51.939587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:51.939785 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:51.939978 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:51.940099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:51.940272 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] No waiting events found dispatching network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:51.941529 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ad1f0139-d556-442b-b1b2-789a1db75bb8 req-09665c46-62b7-4923-923b-2cacbed1ff35 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:51.972382 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0008845480001582473 future=<Future at 0x7d7aa44b95e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:51.972613 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:51.972613 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.5556186439998783 future=<Future at 0x7d7ae410b4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:51.973299 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.555506645999685 future=<Future at 0x7d7ae410b4d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:51.973635 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] Emitting event <LifecycleEvent: 1779771816.9713933, 02578b5c-b022-4d9a-ac22-3552d7e39881 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:51.974323 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] VM Stopped (Lifecycle Event)
May 26 05:03:51.988868 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999735349000275 future=<Future at 0x7d7ac41106b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:51.994770 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Instance destroyed successfully.
May 26 05:03:51.994770 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'resources' on Instance uuid 71b40a96-611b-4143-a895-e464b0ce391d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:03:52.132465 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:52.343870 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73ecdae0-1256-4db2-97f8-6bed83cc0506 req-b14428c5-dcee-403e-b848-e35051f0dc17 service nova] Releasing lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:52.344526 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquired lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:03:52.344674 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:03:52.479656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-012a5381-101b-4353-8999-8a18986a6bb7 None None] [instance: 02578b5c-b022-4d9a-ac22-3552d7e39881] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:52.499401 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:01:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-1755426010',display_name='tempest-VolumesBackupsTest-instance-1755426010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-1755426010',id=23,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM0kjC/yUfLG2hQWvosPDwQa6+BEcuTQ0S7AUG6ep6VaM5EgLQTPYg1QAqASJeWYcIAuLz3jm2Tdm/8WhmwtiWAwwndtwr0kzrrCQyJimmZxJ5e4DyrRF7nJKKmwE6Ju6w==',key_name='tempest-keypair-1953515033',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:02:16Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-kz1yjg5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:02:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=71b40a96-611b-4143-a895-e464b0ce391d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:03:52.499672 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "e9ada007-95ef-495c-83fe-e5e42726bda7", "address": "fa:16:3e:fc:c9:eb", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ada007-95", "ovs_interfaceid": "e9ada007-95ef-495c-83fe-e5e42726bda7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:03:52.500342 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:03:52.500665 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:03:52.503926 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:52.503926 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9ada007-95, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:52.504899 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:52.506611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:52.508176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:52.508176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b18ff5f9-8244-4096-941a-6ec0465a2407) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:03:52.511241 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:52.512878 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:03:52.515398 np0000001388 nova-compute[98319]: INFO os_vif [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:c9:eb,bridge_name='br-int',has_traffic_filtering=True,id=e9ada007-95ef-495c-83fe-e5e42726bda7,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ada007-95')
May 26 05:03:52.515902 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Deleting instance files /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d_del
May 26 05:03:52.517661 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Deletion of /opt/stack/data/nova/instances/71b40a96-611b-4143-a895-e464b0ce391d_del complete
May 26 05:03:52.795111 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:53.030991 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:03:53.034520 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:03:53.037266 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:03:53.037266 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:03:53.037266 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:53.222879 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:03:53.226892 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:03:53.228527 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:03:53.228944 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Creating image(s)
May 26 05:03:53.229612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:53.229825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:53.230439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:53.231487 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:53.235592 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:53.237496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:53.353834 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:53.355106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:53.355737 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:53.357325 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:53.361236 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:03:53.362631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:53.474163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:53.475700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:53.537381 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:53.539706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk 1073741824" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:53.540083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:53.540509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:53.651395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:53.652962 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:03:53.653475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:03:53.765114 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:03:53.765749 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Cannot resize image /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:03:53.766574 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:03:53.768030 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Ensure instance console log exists: /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:03:53.768030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:53.768030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:53.768030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:53.869369 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:54.045252 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:54.046006 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] Acquiring lock "71b40a96-611b-4143-a895-e464b0ce391d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:54.046006 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:54.050027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] Lock "71b40a96-611b-4143-a895-e464b0ce391d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:54.050027 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] No waiting events found dispatching network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:03:54.050027 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a115ed1c-5d9a-4bb4-8edb-ac93b1000351 req-de9df283-f8bb-4a02-9db1-8bd50abb966c service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-unplugged-e9ada007-95ef-495c-83fe-e5e42726bda7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:03:54.431693 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0cb2126-389f-4ce6-84f6-87cb956e3d68 req-a960de4f-34e0-46ee-9fd6-4df482dd8356 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Received event network-vif-deleted-e9ada007-95ef-495c-83fe-e5e42726bda7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:03:54.431693 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-d0cb2126-389f-4ce6-84f6-87cb956e3d68 req-a960de4f-34e0-46ee-9fd6-4df482dd8356 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Neutron deleted interface e9ada007-95ef-495c-83fe-e5e42726bda7; detaching it from the instance and deleting it from the info cache
May 26 05:03:54.431693 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d0cb2126-389f-4ce6-84f6-87cb956e3d68 req-a960de4f-34e0-46ee-9fd6-4df482dd8356 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:54.475856 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:03:54.529026 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0007370830003310402 future=<Future at 0x7d7ae410b4d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:54.529897 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Emitting event <LifecycleEvent: 1779771819.5281706, f40c13f1-a910-4f6a-b000-2baa84ce86fa => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:03:54.530303 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:54.530540 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.458147666000059 future=<Future at 0x7d7ac41106b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:54.530611 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.45801706300017 future=<Future at 0x7d7ac41106b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:03:54.531036 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] VM Stopped (Lifecycle Event)
May 26 05:03:54.862440 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:54.943145 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0cb2126-389f-4ce6-84f6-87cb956e3d68 req-a960de4f-34e0-46ee-9fd6-4df482dd8356 service nova] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Detach interface failed, port_id=e9ada007-95ef-495c-83fe-e5e42726bda7, reason: Instance 71b40a96-611b-4143-a895-e464b0ce391d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:03:55.010468 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updating instance_info_cache with network_info: [{"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:03:55.035677 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: f40c13f1-a910-4f6a-b000-2baa84ce86fa] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:03:55.366316 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Took 2.33 seconds to deallocate network for instance.
May 26 05:03:55.455117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:55.514704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Releasing lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:03:55.515080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance network_info: |[{"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:03:55.519372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Start _get_guest_xml network_info=[{"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': -1, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '7cb37639-dad9-4cf4-9993-8ed0351ac14e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0ab1ef45-6ef4-4886-8f22-9d2c4c8af777', 'attached_at': '', 'detached_at': '', 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'serial': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:03:55.525928 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:03:55.527627 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-instance-2110617468', uuid='0ab1ef45-6ef4-4886-8f22-9d2c4c8af777'), owner=OwnerMeta(userid='34b4ac452e8c430695b189e1083a0c68', username='tempest-VolumesBackupsTest-355836651-project-member', projectid='21271255e15b4780a232d67028f62d32', projectname='tempest-VolumesBackupsTest-355836651'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771835.5268977) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:03:55.529548 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:03:55.529817 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:03:55.530997 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:03:55.531250 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:03:55.534602 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:03:55.534936 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:03:55.535490 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:03:55.535490 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:03:55.535490 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:03:55.535490 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:03:55.535659 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:03:55.535802 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:03:55.535999 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:03:55.535999 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:03:55.536627 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:03:55.536627 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:03:55.562397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:03:55.563052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:03:55.563052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:55.563502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:55.563729 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:03:55.585349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:55.586314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:03:55.587150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:55.587991 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:55.590755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:03:55.591016 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:55.609088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:55.609088 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:55.619565 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:03:55.619565 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7] added
May 26 05:03:55.630100 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:55.630100 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:55.630100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:55.630743 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0431(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:55.632921 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7] added
May 26 05:03:55.636056 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:03:55.636056 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:55.636056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:03:55.636454 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0451(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:03:55.636454 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:03:55.879827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:55.879827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:56.247385 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:03:56.247809 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:03:56.467811 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:56.631816 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:03:56.637255 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:56.649011 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:56.649011 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:03:56.660601 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:03:56.660601 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.671019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.680458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.690978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:03:56.690978 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:56.690978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:03:56.690978 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:56.690978 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:03:56.690978 np0000001388 nova-compute[98319]: 
May 26 05:03:56.703018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:03:56.703018 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:56.703018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:03:56.703018 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:56.703018 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:03:56.703018 np0000001388 nova-compute[98319]: 
May 26 05:03:56.737941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.40.100,3260]
May 26 05:03:56.737941 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.40.100,3260] successful.
May 26 05:03:56.737941 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.752685 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:03:56.758591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:56.772946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:56.772946 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:56.773537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:56.773537 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:56.773537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:56.773951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:56.774547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] HCTL ('7', '-', '-', 0) found on session 69 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:56.774547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:56.798815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Searching for a device in session 69 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:56.800803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:57.133835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:57.263981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:57.350422 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Deleted allocations for instance 71b40a96-611b-4143-a895-e464b0ce391d
May 26 05:03:57.512762 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:57.741865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.50.100,3260]
May 26 05:03:57.741865 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.50.100,3260] successful.
May 26 05:03:57.741865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:57.756190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:03:57.774505 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:57.774505 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:57.774505 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:03:57.776139 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] HCTL ('8', '-', '-', 0) found on session 70 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:03:57.776139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:03:57.796340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Searching for a device in session 70 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:58.364546 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4da913fb-c199-4644-8317-c4f9da1472ba tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "71b40a96-611b-4143-a895-e464b0ce391d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.241s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:03:58.797059 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Searching for a device in session 70 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:03:58.797275 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:03:58.972897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:03:59.361684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:03:59.361913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:03:59.637097 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Found WWN SStorPool_iSCSI_DISK_1034578903445798992 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:03:59.637613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.074s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:03:59.637613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] <== connect_volume: return (4074ms) {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798992', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798992'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:03:59.637763 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Attached iSCSI volume {'type': 'block', 'scsi_wwn': 'SStorPool_iSCSI_DISK_1034578903445798992', 'path': '/dev/dm-0', 'multipath_id': 'SStorPool_iSCSI_DISK_1034578903445798992'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:03:59.867627 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:04:00.144754 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-2110617468',display_name='tempest-instance-2110617468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-instance-2110617468',id=28,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQPNQ2/c/fzf/N6cIPZ4IAwaanBbFFjhO9H+F7HHXrkty/IRG6YILNDQNs0cjqO16l/xYbuoRieJTn4DmJdluy/cm9BuZ48JjdNNEWsjV6GPdPE9LMxvOQXY6Qk1w6IRw==',key_name='tempest-keypair-96877500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21271255e15b4780a232d67028f62d32',ramdisk_id='',reservation_id='r-v2xm8wpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-355836651',owner_user_name='tempest-VolumesBackupsTest-355836651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b4ac452e8c430695b189e1083a0c68',uuid=0ab1ef45-6ef4-4886-8f22-9d2c4c8af777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:00.145004 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converting VIF {"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:00.145708 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:00.146455 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:00.352931 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:00.353167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:00.437701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:00.438031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:00.441715 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:00.445629 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Claim successful on node np0000001388
May 26 05:04:00.651319 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <uuid>0ab1ef45-6ef4-4886-8f22-9d2c4c8af777</uuid>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <name>instance-0000001c</name>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:name>tempest-instance-2110617468</nova:name>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:03:55</nova:creationTime>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:user uuid="34b4ac452e8c430695b189e1083a0c68">tempest-VolumesBackupsTest-355836651-project-member</nova:user>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:project uuid="21271255e15b4780a232d67028f62d32">tempest-VolumesBackupsTest-355836651</nova:project>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         <nova:port uuid="0959a8ad-26da-4a87-9979-27832a4913eb">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="serial">0ab1ef45-6ef4-4886-8f22-9d2c4c8af777</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="uuid">0ab1ef45-6ef4-4886-8f22-9d2c4c8af777</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.config"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <alias name="ua-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <serial>7a6ba535-58a9-47e2-a7e5-64cf25d32fa7</serial>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:c5:80:bc"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <target dev="tap0959a8ad-26"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/console.log" append="off"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:00.651319 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:00.653493 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Preparing to wait for external event network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:00.653493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:00.653493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:00.653493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:00.653967 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-instance-2110617468',display_name='tempest-instance-2110617468',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-instance-2110617468',id=28,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQPNQ2/c/fzf/N6cIPZ4IAwaanBbFFjhO9H+F7HHXrkty/IRG6YILNDQNs0cjqO16l/xYbuoRieJTn4DmJdluy/cm9BuZ48JjdNNEWsjV6GPdPE9LMxvOQXY6Qk1w6IRw==',key_name='tempest-keypair-96877500',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21271255e15b4780a232d67028f62d32',ramdisk_id='',reservation_id='r-v2xm8wpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-355836651',owner_user_name='tempest-VolumesBackupsTest-355836651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b4ac452e8c430695b189e1083a0c68',uuid=0ab1ef45-6ef4-4886-8f22-9d2c4c8af777,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:00.654206 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converting VIF {"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:00.659755 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:00.660021 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:00.660410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.660659 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:00.661026 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:00.662286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.662346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '20083609-3ee3-5bdb-bbf3-1be22be3f581', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:00.663054 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.663798 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:00.663956 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.667741 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.667976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0959a8ad-26, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:00.668321 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0959a8ad-26, col_values=(('qos', UUID('a71aa6e8-249e-4b27-ba52-111bddc2fecb')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:00.668482 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0959a8ad-26, col_values=(('external_ids', {'iface-id': '0959a8ad-26da-4a87-9979-27832a4913eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:80:bc', 'vm-uuid': '0ab1ef45-6ef4-4886-8f22-9d2c4c8af777'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:00.669398 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.670543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:00.675374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:00.676510 np0000001388 nova-compute[98319]: INFO os_vif [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26')
May 26 05:04:00.856656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:04:01.413373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:01.713738 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:01.714103 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:02.135817 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:02.194908 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:02.195117 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:02.195274 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:02.195399 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] No VIF found with MAC fa:16:3e:c5:80:bc, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:02.195828 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Using config drive
May 26 05:04:02.216194 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:02.701581 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:02.723108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.285s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:02.723682 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:04:02.726758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.314s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:02.730529 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:02.731568 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Claim successful on node np0000001388
May 26 05:04:02.841567 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Creating config drive at /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.config
May 26 05:04:02.848226 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppktq4xo6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:02.897429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppktq4xo6" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:03.237310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:04:03.237599 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:04:03.238041 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:03.238445 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:03.343073 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0939d86f1084b2c982cd2582f27ad96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b6c6daea7064df7973a1e2e20e2582f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:04:03.388940 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.414731 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.418894 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.536815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.634316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a343778-8d4e-48d6-b2bd-9d0b140f37d5 req-5d25fdbb-c20a-45c2-960e-898db954db87 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:03.636280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a343778-8d4e-48d6-b2bd-9d0b140f37d5 req-5d25fdbb-c20a-45c2-960e-898db954db87 service nova] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:03.636577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a343778-8d4e-48d6-b2bd-9d0b140f37d5 req-5d25fdbb-c20a-45c2-960e-898db954db87 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:03.636671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a343778-8d4e-48d6-b2bd-9d0b140f37d5 req-5d25fdbb-c20a-45c2-960e-898db954db87 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:03.636806 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a343778-8d4e-48d6-b2bd-9d0b140f37d5 req-5d25fdbb-c20a-45c2-960e-898db954db87 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Processing event network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:03.739729 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:04:03.773058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.783786 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.806724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:03.995002 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Successfully created port: 676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:04:04.098420 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:04.099316 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:04.244582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:04:04.343184 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:04.344190 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771844.3437352, 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:04.344478 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] VM Started (Lifecycle Event)
May 26 05:04:04.345954 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:04.348322 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance spawned successfully.
May 26 05:04:04.348776 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:04.602864 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:04.624626 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Successfully updated port: 676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:04:04.694572 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-changed-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:04.694772 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Refreshing instance network info cache due to event network-changed-676f5209-3ac4-47fa-99ef-82e1fbd9de7f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:04.695016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] Acquiring lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:04.695178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] Acquired lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:04.695377 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Refreshing network info cache for port 676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:04.750663 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Booting with volume 27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 at /dev/vda
May 26 05:04:04.797885 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:04.813019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:04:04.840917 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:04.865224 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:04.869910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.870339 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.870874 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.871325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.872027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.872706 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:04.880772 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:04:04.881212 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:04.884553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:04:04.898476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:04:04.899576 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe65:7dbe', 'fe80::4cc9:2fff:fe63:6c1', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fec5:80bc', 'fe80::b881:84ff:fe80:e951'] 
May 26 05:04:04.899737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:04:04.899826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:04:04.899972 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:04.900174 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating existing volume attachment record: fdd15b03-d055-466e-bc0f-4e2a564409d8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:04:05.111368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:05.112107 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:04:05.130868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:05.198869 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:05.332278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:05.382188 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Took 12.15 seconds to spawn the instance on the hypervisor.
May 26 05:04:05.382433 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:05.387885 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:05.389494 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771845.3892658, 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:05.389752 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] VM Paused (Lifecycle Event)
May 26 05:04:05.511731 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:05.621256 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:04:05.622467 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:04:05.622467 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:05.622467 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:05.681790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:05.700982 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:04:05.707676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:05.708705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:05.709180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:05.709771 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:05.710423 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] No waiting events found dispatching network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:05.710423 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-01e32ffa-0606-4ab0-937d-00914291f671 req-04e6385c-2c75-4f02-88db-b03efa77ac80 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received unexpected event network-vif-plugged-0959a8ad-26da-4a87-9979-27832a4913eb for instance with vm_state active and task_state None.
May 26 05:04:05.893645 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:05.895192 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Took 19.95 seconds to build instance.
May 26 05:04:05.897853 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771845.8974185, 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:05.897853 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] VM Resumed (Lifecycle Event)
May 26 05:04:06.013361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-902ae8dd-dd1b-4f21-824c-89db7ae46adc req-6068343a-ea01-43f2-a2dc-78411e8ab07d service nova] Releasing lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:06.016754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquired lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:06.016943 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:06.124928 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:04:06.171380 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Successfully created port: 20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:04:06.397740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88341c38-91b4-4385-a88a-5c6e25b768d1 tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.462s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:06.399652 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:06.401464 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:06.628378 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:04:06.651070 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:06.848364 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Successfully updated port: 20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:04:06.861729 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:06.929690 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-changed-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:06.930009 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Refreshing instance network info cache due to event network-changed-20c312b9-39e6-4c91-a234-2318488c511f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:06.930121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] Acquiring lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:06.933308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] Acquired lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:06.933308 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Refreshing network info cache for port 20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:06.990663 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0019470879997243173 future=<Future at 0x7d7ac41106b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:06.991987 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Emitting event <LifecycleEvent: 1779771831.9885042, 71b40a96-611b-4143-a895-e464b0ce391d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:06.993443 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:06.993677 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] VM Stopped (Lifecycle Event)
May 26 05:04:07.018527 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating instance_info_cache with network_info: [{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:07.040313 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:04:07.040723 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:07.041255 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating image(s)
May 26 05:04:07.041708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:04:07.042190 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Ensure instance console log exists: /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:07.042584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:07.042739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:07.043121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:07.137369 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Booting with volume 06171d9f-41de-436f-980e-759d775d7a7d at /dev/vda
May 26 05:04:07.143989 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:07.187389 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:07.198931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:04:07.221872 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:07.264620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:04:07.264938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:04:07.274669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:04:07.275894 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe65:7dbe', 'fe80::4cc9:2fff:fe63:6c1', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fec5:80bc', 'fe80::b881:84ff:fe80:e951'] 
May 26 05:04:07.276083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:04:07.276083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:04:07.276441 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:07.276653 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Updating existing volume attachment record: f13e68fb-ae21-48db-ab24-7653b30300c5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:04:07.351122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:07.439954 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:07.496838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: 71b40a96-611b-4143-a895-e464b0ce391d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:07.520781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Releasing lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:07.521278 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance network_info: |[{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:04:07.522225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start _get_guest_xml network_info=[{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'fdd15b03-d055-466e-bc0f-4e2a564409d8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '569c7477-611f-4fc2-bbc9-b6ce2a2c92d1', 'attached_at': '', 'detached_at': '', 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'serial': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:07.524192 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:07.525493 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-637693764', uuid='569c7477-611f-4fc2-bbc9-b6ce2a2c92d1'), owner=OwnerMeta(userid='e0939d86f1084b2c982cd2582f27ad96', username='tempest-ServerActionsV293TestJSON-1167911011-project-member', projectid='9b6c6daea7064df7973a1e2e20e2582f', projectname='tempest-ServerActionsV293TestJSON-1167911011'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771847.525097) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:07.526480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:07.526848 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:07.527703 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:07.527906 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:07.528873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:07.529209 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:07.529429 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:07.529584 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:07.529770 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:07.529908 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:07.530054 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:07.530317 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:07.530466 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:07.530979 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:07.530979 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:07.530979 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:07.544074 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:07.549316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:04:07.549625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:07.549779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:07.711983 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:07.783681 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-changed-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:07.783898 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Refreshing instance network info cache due to event network-changed-0959a8ad-26da-4a87-9979-27832a4913eb. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:07.785149 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] Acquiring lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:07.785454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] Acquired lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:07.786352 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Refreshing network info cache for port 0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:08.215317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b349719-959f-45b7-987f-36926678161c req-e435d31e-a4b0-4fdd-8c59-6f0571a9204a service nova] Releasing lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:08.215986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:08.216171 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:08.295149 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:08.607918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.057s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:08.608757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:04:08.622857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:08.623422 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:08.623789 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:08.624515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:08.625720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:08.626270 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:08.637797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:08.637797 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:08.644924 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:08.644924 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:08.656799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0] added
May 26 05:04:08.656799 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:08.656799 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:08.656799 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:08.656799 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:08.656799 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:08.656799 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:08.657473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:08.657473 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:08.657473 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:08.661984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0] added
May 26 05:04:08.661984 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:08.661984 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:08.661984 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:08.661984 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:08.661984 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:08.661984 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:08.662268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:08.662426 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0365(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:08.662588 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:08.721844 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:08.803406 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:08.903778 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updated VIF entry in instance network info cache for port 0959a8ad-26da-4a87-9979-27832a4913eb. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:08.904090 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updating instance_info_cache with network_info: [{"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:09.049827 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:09.225275 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Updating instance_info_cache with network_info: [{"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:09.406664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e4b8bebf-fbfe-403c-96d4-68ddd3887c73 req-0d14533e-e33a-4d69-9867-8dad0546866a service nova] Releasing lock "refresh_cache-0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Creating image(s)
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Ensure instance console log exists: /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:09.416995 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:09.417417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:09.417417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:09.657906 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:09.662940 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:09.672970 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:09.672970 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:09.679038 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:09.679038 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.688190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.693860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.705841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.705841 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.705841 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.705841 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.705841 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.705841 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:09.706155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.706155 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.706155 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.706155 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.706155 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.706155 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:09.712993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.712993 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.712993 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.712993 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.712993 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.712993 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:09.713302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.713302 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.713302 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.713302 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.713302 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.713302 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:09.727917 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-07d0130e-910b-4ab0-8c20-b2fbde08ac3c" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:09.728277 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance network_info: |[{"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:04:09.728934 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Start _get_guest_xml network_info=[{"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'f13e68fb-ae21-48db-ab24-7653b30300c5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '07d0130e-910b-4ab0-8c20-b2fbde08ac3c', 'attached_at': '', 'detached_at': '', 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'serial': '06171d9f-41de-436f-980e-759d775d7a7d', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:09.732866 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:09.734172 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-1962942053', uuid='07d0130e-910b-4ab0-8c20-b2fbde08ac3c'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771849.7337816) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:09.737941 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:09.738756 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:09.741872 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:09.742080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:09.743102 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:09.743518 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:09.743711 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:09.743840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:09.744012 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:09.744177 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:09.744333 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:09.744533 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:09.744667 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:09.744819 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:09.744962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:09.745146 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:09.751283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260]
May 26 05:04:09.751283 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260] successful.
May 26 05:04:09.751283 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.764495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:04:09.764765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:09.764932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:09.768383 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260]
May 26 05:04:09.768383 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260] successful.
May 26 05:04:09.768383 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.776758 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.785850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.798017 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.798494 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:09.798686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.175s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:09.798805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:09.799675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] HCTL ('12', '-', '-', 0) found on session 74 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:09.799841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:09.807755 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] HCTL ('13', '-', '-', 0) found on session 75 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:09.807755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:09.823980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:09.830161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 75 and hctl ['13', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:10.687419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:10.825866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 74 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:10.825866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:10.830622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 75 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:10.830827 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:11.628368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:04:12.146233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:12.648647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Found WWN 330000000446e21b4 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:04:12.648940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:12.649141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== connect_volume: return (5099ms) {'type': 'block', 'scsi_wwn': '330000000446e21b4', 'path': '/dev/dm-4', 'multipath_id': '330000000446e21b4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:12.649323 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000446e21b4', 'path': '/dev/dm-4', 'multipath_id': '330000000446e21b4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:04:12.650309 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.885s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:12.650309 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:04:12.661674 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:12.662498 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:12.663019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:12.663243 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:12.663696 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:12.663956 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:12.675797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:12.675797 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:12.683231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:12.683231 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:12.688445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d] added
May 26 05:04:12.688445 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:12.688445 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:12.688445 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:12.688445 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:12.688445 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:12.688445 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:12.688897 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:12.689077 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:12.689260 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:12.694091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d] added
May 26 05:04:12.694091 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:12.694091 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:12.694091 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:12.694091 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:12.694091 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:12.694091 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:12.694305 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:12.694388 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:12.694529 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:13.158445 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-637693764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:13.159012 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:13.159289 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:13.160140 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lazy-loading 'pci_devices' on Instance uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:13.663763 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <uuid>569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</uuid>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <name>instance-0000001d</name>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsV293TestJSON-server-637693764</nova:name>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:07</nova:creationTime>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:user uuid="e0939d86f1084b2c982cd2582f27ad96">tempest-ServerActionsV293TestJSON-1167911011-project-member</nova:user>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:project uuid="9b6c6daea7064df7973a1e2e20e2582f">tempest-ServerActionsV293TestJSON-1167911011</nova:project>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         <nova:port uuid="676f5209-3ac4-47fa-99ef-82e1fbd9de7f">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="serial">569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="uuid">569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <alias name="ua-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <serial>27dd5aab-e57a-48be-8f31-bc0bf7b55ad0</serial>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:08:35:60"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <target dev="tap676f5209-3a"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/console.log" append="off"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:13.663763 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:13.665620 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Preparing to wait for external event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:13.665620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:13.665620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:13.665620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:13.665620 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-637693764',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:13.665845 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:13.666489 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:13.666787 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:13.667070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.667302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:13.667495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:13.668970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.668970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31b2c4ad-e70f-571f-9c8a-2a974b992442', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:13.672082 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.672082 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:13.675163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.675163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap676f5209-3a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:13.675163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap676f5209-3a, col_values=(('qos', UUID('5033a06f-4763-4152-8b8b-3c35c3495202')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:13.675163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap676f5209-3a, col_values=(('external_ids', {'iface-id': '676f5209-3ac4-47fa-99ef-82e1fbd9de7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:35:60', 'vm-uuid': '569c7477-611f-4fc2-bbc9-b6ce2a2c92d1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:13.676049 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.677704 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:13.681541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:13.682782 np0000001388 nova-compute[98319]: INFO os_vif [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a')
May 26 05:04:13.689720 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:13.695031 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:13.705908 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:13.705908 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:13.712840 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:13.712840 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.718555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.728649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.735911 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.736212 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.745844 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.746062 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:13.781369 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.50.100,3260]
May 26 05:04:13.781369 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.50.100,3260] successful.
May 26 05:04:13.781369 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.788475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.40.100,3260]
May 26 05:04:13.788475 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.40.100,3260] successful.
May 26 05:04:13.788475 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.793488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.800687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.814997 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.815428 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:13.815717 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:13.815717 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:13.816538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('14', '-', '-', 0) found on session 76 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:13.816635 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.817753 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [72] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [73] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:13.818070 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:13.818369 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:13.818445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:13.819350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('15', '-', '-', 0) found on session 77 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:13.819436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:13.837056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 76 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:13.837056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:13.847649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 77 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:13.847850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:14.664351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:04:14.954723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:14.954906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:15.215063 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:15.215753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:15.215894 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No VIF found with MAC fa:16:3e:08:35:60, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:15.218206 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Using config drive
May 26 05:04:15.457941 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lazy-loading 'flavor' on Instance uuid 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:15.682347 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 330000000d0358980 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:04:15.682893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:15.682893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (5918ms) {'type': 'block', 'scsi_wwn': '330000000d0358980', 'path': '/dev/dm-7', 'multipath_id': '330000000d0358980'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:15.683111 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d0358980', 'path': '/dev/dm-7', 'multipath_id': '330000000d0358980'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:04:15.742176 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:15.923154 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating config drive at /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config
May 26 05:04:15.930952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpan7kdw0a {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:15.967714 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Ignoring supplied device name: /dev/vdb
May 26 05:04:15.992897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpan7kdw0a" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:16.189800 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1962942053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-1962942053',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-vord6rf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:07Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=07d0130e-910b-4ab0-8c20-b2fbde08ac3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:16.190005 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:16.190622 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:16.191311 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid 07d0130e-910b-4ab0-8c20-b2fbde08ac3c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:16.464342 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.471688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:16.504395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.609481 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <uuid>07d0130e-910b-4ab0-8c20-b2fbde08ac3c</uuid>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <name>instance-0000001e</name>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-1962942053</nova:name>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:09</nova:creationTime>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         <nova:port uuid="20c312b9-39e6-4c91-a234-2318488c511f">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="serial">07d0130e-910b-4ab0-8c20-b2fbde08ac3c</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="uuid">07d0130e-910b-4ab0-8c20-b2fbde08ac3c</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/disk.config"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <alias name="ua-06171d9f-41de-436f-980e-759d775d7a7d"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-7"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <serial>06171d9f-41de-436f-980e-759d775d7a7d</serial>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <shareable/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a4:35:e8"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <target dev="tap20c312b9-39"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/console.log" append="off"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:16.702221 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Preparing to wait for external event network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1962942053',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-1962942053',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-vord6rf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:07Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=07d0130e-910b-4ab0-8c20-b2fbde08ac3c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:16.702221 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:16.707391 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:16.709048 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.709404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:16.709688 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:16.710544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.710737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e32df3f7-b369-55cf-9808-f515b08ebba1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:16.712275 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.712941 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:16.716863 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.721191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.721191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20c312b9-39, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:16.721191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20c312b9-39, col_values=(('qos', UUID('219c275b-cb5a-4126-a1ab-b43fdac2d6d1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:16.721191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20c312b9-39, col_values=(('external_ids', {'iface-id': '20c312b9-39e6-4c91-a234-2318488c511f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:35:e8', 'vm-uuid': '07d0130e-910b-4ab0-8c20-b2fbde08ac3c'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:16.723250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.723250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:16.730823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.731387 np0000001388 nova-compute[98319]: INFO os_vif [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39')
May 26 05:04:16.891510 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.899919 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.904842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.944546 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.952687 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:16.972571 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4a37d94d-32a5-436f-8118-c2ce597c7363 req-60e85c1f-8f4a-40c4-8077-e06c53f23a6e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:16.972571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a37d94d-32a5-436f-8118-c2ce597c7363 req-60e85c1f-8f4a-40c4-8077-e06c53f23a6e service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:16.972571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a37d94d-32a5-436f-8118-c2ce597c7363 req-60e85c1f-8f4a-40c4-8077-e06c53f23a6e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:16.972571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4a37d94d-32a5-436f-8118-c2ce597c7363 req-60e85c1f-8f4a-40c4-8077-e06c53f23a6e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:16.972903 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4a37d94d-32a5-436f-8118-c2ce597c7363 req-60e85c1f-8f4a-40c4-8077-e06c53f23a6e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Processing event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:17.155744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:17.513587 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771857.512635, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:17.513587 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Started (Lifecycle Event)
May 26 05:04:17.516378 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:17.520136 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:17.523331 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance spawned successfully.
May 26 05:04:17.523331 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:17.702666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:17.704112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:17.704112 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Attaching volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c to /dev/vdb
May 26 05:04:17.755148 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:17.767592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:04:17.773509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:17.773874 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:17.791723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:17.830443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:04:17.831434 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:04:17.840412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:04:17.843219 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe65:7dbe', 'fe80::4cc9:2fff:fe63:6c1', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fec5:80bc', 'fe80::b881:84ff:fe80:e951', 'fe80::fc16:3eff:fe08:3560', 'fe80::c08b:afff:fe43:df92'] 
May 26 05:04:17.843219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:04:17.843219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:04:17.843219 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:17.843219 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating existing volume attachment record: 973827ce-e621-4a4a-a303-ddd8faa0a091 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:04:18.018000 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:18.022100 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:18.032243 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.032391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.032694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.032988 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.033331 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.033653 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:18.254259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:18.254441 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:18.254606 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:a4:35:e8, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:18.255151 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Using config drive
May 26 05:04:18.276538 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:04:18.402177 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:04:18.402177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:18.402177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:18.402177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:18.402177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:04:18.413639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:18.414342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:18.414724 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:18.416301 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:18.416528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:18.416692 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:18.429809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:18.429809 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:18.431866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:18.431866 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c] added
May 26 05:04:18.444282 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:18.444282 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:18.444282 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:18.447973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c] added
May 26 05:04:18.447973 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:18.447973 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:18.447973 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:18.447973 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:18.447973 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:18.447973 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:18.448303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:18.448371 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:18.448480 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:18.525088 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:18.525432 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771858.5252552, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:18.525540 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Paused (Lifecycle Event)
May 26 05:04:18.540803 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Took 11.50 seconds to spawn the instance on the hypervisor.
May 26 05:04:18.540956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:18.761727 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:18.844440 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:18.844697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:18.847827 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:18.848002 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Claim successful on node np0000001388
May 26 05:04:18.909696 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Creating config drive at /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/disk.config
May 26 05:04:18.913215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8ngqcvmg {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:18.966664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8ngqcvmg" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:19.029109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:19.034524 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771859.0326378, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:19.034524 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Resumed (Lifecycle Event)
May 26 05:04:19.042257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:19.043936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:19.044297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:19.044514 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:19.044745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:19.045302 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a34cec2b-9d71-44c1-85f1-0bad52a527ca req-e8ae7922-13c1-4db4-86e5-18dfc248fe1b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received unexpected event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with vm_state active and task_state None.
May 26 05:04:19.053644 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Took 18.68 seconds to build instance.
May 26 05:04:19.398857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.428896 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.445701 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:19.448841 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:19.465429 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:19.465429 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.480118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:19.481301 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:19.481301 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.498731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.509751 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.522791 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.523032 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:19.527873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.537429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:19.545792 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:19.557645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.195s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:19.598466 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.40.100,3260]
May 26 05:04:19.598466 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.40.100,3260] successful.
May 26 05:04:19.598466 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.612614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.50.100,3260]
May 26 05:04:19.612614 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.50.100,3260] successful.
May 26 05:04:19.612614 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.617674 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.625389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.642776 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.643046 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:19.643409 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:19.643536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.643940 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [71] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395f39b5-bc6d-4def-b7b6-2987a729dc28 (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:19.644215 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:19.644454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:19.644454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:19.645383 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] HCTL ('11', '-', '-', 0) found on session 79 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:19.645511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:19.646476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] HCTL ('10', '-', '-', 0) found on session 78 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:19.646531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:19.676865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Searching for a device in session 79 and hctl ['11', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:19.676865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:19.687523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Searching for a device in session 78 and hctl ['10', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:19.687523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:19.833924 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.842422 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.876909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:19.978099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:19.978613 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:19.978817 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Shelving
May 26 05:04:20.255971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:20.255971 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:20.390552 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771860.390105, 07d0130e-910b-4ab0-8c20-b2fbde08ac3c => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:20.391089 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] VM Started (Lifecycle Event)
May 26 05:04:20.415616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:04:20.618842 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:20.619230 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:20.761885 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:20.895927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:20.899577 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771860.8992515, 07d0130e-910b-4ab0-8c20-b2fbde08ac3c => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:20.899742 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] VM Paused (Lifecycle Event)
May 26 05:04:21.012221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.014603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.040501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.043281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.067730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.070994 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.146829 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:21.149539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Processing event network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:21.150895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:21.151586 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] No waiting events found dispatching network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received unexpected event network-vif-plugged-20c312b9-39e6-4c91-a234-2318488c511f for instance with vm_state building and task_state spawning.
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-changed-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Refreshing instance network info cache due to event network-changed-676f5209-3ac4-47fa-99ef-82e1fbd9de7f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Acquiring lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Acquired lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:21.154012 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Refreshing network info cache for port 676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:21.158658 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:21.161856 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance spawned successfully.
May 26 05:04:21.162489 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:21.274346 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.429s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:21.274797 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:04:21.298413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.307248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.332348 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance destroyed successfully.
May 26 05:04:21.332690 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'numa_topology' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:21.405607 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:21.407454 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771861.407239, 07d0130e-910b-4ab0-8c20-b2fbde08ac3c => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:21.407781 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] VM Resumed (Lifecycle Event)
May 26 05:04:21.433391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Found WWN 330000000f945ecf2 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:04:21.433837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:21.434224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000f945ecf2', 'path': '/dev/dm-3', 'multipath_id': '330000000f945ecf2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:21.434303 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f945ecf2', 'path': '/dev/dm-3', 'multipath_id': '330000000f945ecf2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:04:21.439803 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lazy-loading 'flavor' on Instance uuid 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:21.501157 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:21.501492 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:21.655761 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:21.674549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.674549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.674549 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.674842 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.675188 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.676221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:21.722671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:21.780919 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:04:21.782755 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:04:21.782755 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:21.783111 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:21.911393 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:21.915645 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:21.942033 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Attempting to attach volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:04:21.946281 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:   <alias name="ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c"/>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:   <serial>2e07e626-cc59-4cbc-8cbc-6f4ee553c82c</serial>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]: </disk>
May 26 05:04:21.946281 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:04:21.978365 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Beginning cold snapshot process
May 26 05:04:21.996553 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26acfb2a785f4250b6e3eb55c04c89b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4b7038bb5e2846eaa31929c5b58679c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:04:22.156896 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:22.167757 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:22.184491 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Took 12.77 seconds to spawn the instance on the hypervisor.
May 26 05:04:22.184729 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:22.285599 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:04:22.346643 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updated VIF entry in instance network info cache for port 676f5209-3ac4-47fa-99ef-82e1fbd9de7f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:22.347422 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating instance_info_cache with network_info: [{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:22.418767 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:22.419223 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99975329200015 future=<Future at 0x7d7aa43a2e10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:22.419642 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999332080000386 future=<Future at 0x7d7aa43a2e10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:22.419802 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999138149000373 future=<Future at 0x7d7aa43a2e10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:22.617756 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:22.618128 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:22.705072 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Took 21.34 seconds to build instance.
May 26 05:04:22.789461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:04:22.849981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ddb14618-a96b-49a9-a868-285f966786d3 req-9dc20adc-3ab7-4f07-84d9-6ce636aaa40f service nova] Releasing lock "refresh_cache-569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:22.906710 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Successfully created port: 117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:04:23.214079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3d406764-e453-467f-8443-4b7aa2475a6b tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.860s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:23.246482 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:23.246953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:23.247228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:23.247968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:23.248179 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:23.250273 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received unexpected event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with vm_state active and task_state shelving_image_pending_upload.
May 26 05:04:23.250467 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:23.250651 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:23.250823 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:23.250968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:23.251110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:23.251263 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-12f98665-4870-48b7-8e1f-5d075dc8df29 req-b0897dca-d07a-4fd5-a6c7-00eff931c14d service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received unexpected event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with vm_state active and task_state shelving_image_pending_upload.
May 26 05:04:23.299400 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Booting with volume f4da4fe4-8372-42d0-9432-fe86f7391ea5 at /dev/vda
May 26 05:04:23.349479 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:23.362127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:04:23.389271 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:23.434481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:04:23.434821 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:04:23.446758 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:04:23.448562 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe65:7dbe', 'fe80::4cc9:2fff:fe63:6c1', 'fe80::fc16:3eff:fec5:80bc', 'fe80::b881:84ff:fe80:e951', 'fe80::fc16:3eff:fe08:3560', 'fe80::c08b:afff:fe43:df92', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58'] 
May 26 05:04:23.449348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:04:23.449786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:04:23.450274 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:23.450735 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updating existing volume attachment record: 8c2e63ad-6c0e-43a5-a8f2-6efe55efd416 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:04:23.493838 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:04:23.494141 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk /opt/stack/data/nova/instances/snapshots/tmpwsp50ap9/1ab78564973d40faae1b8540a6a4b9e5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:23.618560 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:23.619355 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:23.639122 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Successfully updated port: 117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:04:23.648237 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:23.648594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:23.648594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:23.649587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] No VIF found with MAC fa:16:3e:65:7d:be, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:23.804576 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk /opt/stack/data/nova/instances/snapshots/tmpwsp50ap9/1ab78564973d40faae1b8540a6a4b9e5" returned: 0 in 0.310s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:23.804914 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Snapshot extracted, beginning image upload
May 26 05:04:24.142123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:24.142358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquired lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:24.142485 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:24.617618 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:24.617967 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:24.770729 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:25.015527 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:25.192608 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updating instance_info_cache with network_info: [{"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:25.226615 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c3289a2c-3ce6-4ed1-ba1e-3c95bc527deb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.522s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:25.328670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-changed-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:25.328670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Refreshing instance network info cache due to event network-changed-117e5611-06eb-476f-82ad-349c67939fb8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:25.329866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] Acquiring lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:25.396186 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event volume-extended-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:25.587224 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:04:25.587224 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:25.587224 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Creating image(s)
May 26 05:04:25.589005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:04:25.594333 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Ensure instance console log exists: /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:25.594333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:25.594333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:25.594333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:25.617822 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:25.618394 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:25.695075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Releasing lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:25.695824 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Instance network_info: |[{"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:04:25.697510 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] Acquired lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:25.697510 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Refreshing network info cache for port 117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:25.698901 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Start _get_guest_xml network_info=[{"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '8c2e63ad-6c0e-43a5-a8f2-6efe55efd416', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '661946b3-8401-4c5e-a448-d14238a62087', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'serial': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:25.705235 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:25.710638 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='instance-depend-image', uuid='661946b3-8401-4c5e-a448-d14238a62087'), owner=OwnerMeta(userid='26acfb2a785f4250b6e3eb55c04c89b3', username='tempest-ImageDependencyTests-1030453916-project-member', projectid='4b7038bb5e2846eaa31929c5b58679c3', projectname='tempest-ImageDependencyTests-1030453916'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771865.708682) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:25.711965 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:25.712401 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:25.713858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:25.714536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:25.715895 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:25.716962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:25.716962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:25.716962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:25.716962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:25.716962 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:25.717401 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:25.717401 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:25.718260 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:25.718260 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:25.718260 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:25.718260 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:25.734665 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:04:25.734665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:25.734665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:25.735098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:25.735356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:04:25.751574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:25.752281 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:25.752807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:25.753022 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:25.753419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:25.753821 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:25.767099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:25.767099 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:25.775065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:25.775065 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:25.782475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:25.783148 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:25.784459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5] added
May 26 05:04:25.784459 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:25.784459 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:25.784459 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:25.784459 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:25.784459 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:25.784459 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:25.784753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:25.784885 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:25.785113 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:25.789151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5] added
May 26 05:04:25.789151 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:25.789151 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:25.789151 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:25.789151 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:25.789151 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:25.789151 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:25.789474 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:25.789474 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0358(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:25.789621 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:25.901931 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Handling volume-extended event for volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c {{(pid=98319) extend_volume /opt/stack/nova/nova/compute/manager.py:11834}}
May 26 05:04:26.125425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:26.127848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:26.128008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:26.128213 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:04:26.202060 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:26.285737 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:04:26.404504 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Cinder extended volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c; extending it to detect new size
May 26 05:04:26.567849 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:26.705782 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Snapshot image upload complete
May 26 05:04:26.706265 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:26.723575 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:26.750890 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updated VIF entry in instance network info cache for port 117e5611-06eb-476f-82ad-349c67939fb8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:26.751759 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updating instance_info_cache with network_info: [{"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:26.785664 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:26.789925 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:26.799386 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:26.799386 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:26.805923 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:26.805923 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.814391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.822687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.834141 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.834562 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.844144 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.844397 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:26.863256 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:26.863514 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:26.867299 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:26.868759 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Claim successful on node np0000001388
May 26 05:04:26.887074 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.50.100,3260]
May 26 05:04:26.887074 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.50.100,3260] successful.
May 26 05:04:26.887074 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.897484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.40.100,3260]
May 26 05:04:26.897484 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.40.100,3260] successful.
May 26 05:04:26.897484 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.906844 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.914782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.927817 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.928319 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:26.928600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:26.928680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:26.930660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] HCTL ('9', '-', '-', 0) found on session 80 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:26.930875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.937442 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:26.938016 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:26.938479 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:26.938479 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:26.939439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] HCTL ('16', '-', '-', 0) found on session 81 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:26.939552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:26.942556 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] calling os-brick to extend iSCSI Volume {{(pid=98319) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:88}}
May 26 05:04:26.942847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] ==> extend_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}), 'kwargs': {}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:26.943001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Acquiring lock "extend_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:26.943468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Lock "extend_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:26.943771 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Extend volume for {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}
May 26 05:04:26.943895 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Multipath discovery for iSCSI enabled
May 26 05:04:26.944143 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Found paths for volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0']
May 26 05:04:26.944618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Checking paths are valid ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0'] {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:711}}
May 26 05:04:26.959267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Searching for a device in session 80 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:26.959267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:26.969424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Searching for a device in session 81 and hctl ['16', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:26.970626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] extend volume ['/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0'] {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:718}}
May 26 05:04:26.970626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Running cmd (subprocess): lsscsi {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.022159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] CMD "lsscsi" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.022733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 26 05:04:27.022940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.40.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', 'host': '10', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 26 05:04:27.035132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Starting size: 1073741824 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 26 05:04:27.067177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] volume size after scsi device rescan 2147483648 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 26 05:04:27.067474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Running cmd (subprocess): lsscsi {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.123078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] CMD "lsscsi" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.123803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] dev_info={'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) get_device_info /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:201}}
May 26 05:04:27.123803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Volume device info = {'device': '/dev/disk/by-path/ip-192.168.50.100:3260-iscsi-iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c-lun-0', 'host': '11', 'channel': '0', 'id': '0', 'lun': '0'} {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:722}}
May 26 05:04:27.132851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Starting size: 1073741824 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:733}}
May 26 05:04:27.164119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] volume size after scsi device rescan 2147483648 {{(pid=98319) extend_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:739}}
May 26 05:04:27.167471 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:27.171326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:04:27.173058 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:04:27.175150 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.175150 np0000001388 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Find Multipath device file for volume WWN 330000000f945ecf2
May 26 05:04:27.175453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Checking to see if /dev/disk/by-id/dm-uuid-mpath-330000000f945ecf2 exists yet. {{(pid=98319) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:482}}
May 26 05:04:27.175625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] /dev/disk/by-id/dm-uuid-mpath-330000000f945ecf2 has shown up. {{(pid=98319) wait_for_path /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:489}}
May 26 05:04:27.206208 np0000001388 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000f945ecf2) current size 1073741824
May 26 05:04:27.218568 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Shelve offloading
May 26 05:04:27.253892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00ac1772-4a06-4795-85f9-49db9558edb2 req-a2599281-05ab-43ba-a494-5496e0afe743 service nova] Releasing lock "refresh_cache-661946b3-8401-4c5e-a448-d14238a62087" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:27.281705 np0000001388 nova-compute[98319]: INFO os_brick.initiator.linuxscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] mpath(/dev/disk/by-id/dm-uuid-mpath-330000000f945ecf2) new size 2147483648
May 26 05:04:27.284152 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] Lock "extend_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.extend_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:27.284152 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] <== extend_volume: return (339ms) 2147483648 {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:27.284152 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Extend iSCSI Volume: new_size=2147483648 {{(pid=98319) extend_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:90}}
May 26 05:04:27.285681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [req-11901f9d-ac5d-4287-8b6f-ecb2a0e312fd req-a01d37fb-9293-40e6-9ca8-0c94dcabb4be service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Resizing target device /dev/dm-3 to 2147483648 {{(pid=98319) _resize_attached_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2945}}
May 26 05:04:27.293705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.294710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.397254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.397604 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:04:27.401754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.512185 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.514976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.612396 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.612947 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:04:27.618224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.707508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.712228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.735764 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance destroyed successfully.
May 26 05:04:27.736591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:27.738282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:27.738471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:27.738810 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:27.805736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.808761 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:27.808761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:27.848127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.039s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:27.848836 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13255MB free_disk=73.1396369934082GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:04:27.848836 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:27.970837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Searching for a device in session 81 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:27.970837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:28.141261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:28.141518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:28.245091 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:28.263120 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:28.263396 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:28.555144 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:28.646229 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Detaching volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c
May 26 05:04:28.700245 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Attempting to driver detach volume 2e07e626-cc59-4cbc-8cbc-6f4ee553c82c from mountpoint /dev/vdb
May 26 05:04:28.709846 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Found disk vdb by alias ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:04:28.714236 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Found disk vdb by alias ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:04:28.714402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Attempting to detach device vdb from instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:04:28.714751 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <alias name="ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c"/>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <serial>2e07e626-cc59-4cbc-8cbc-6f4ee553c82c</serial>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]: </disk>
May 26 05:04:28.714751 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:04:28.717638 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:28.725954 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Successfully detached device vdb from instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 from the persistent domain config.
May 26 05:04:28.726125 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] (1/8): Attempting to detach device vdb with device alias ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c from instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:04:28.726396 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <alias name="ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c"/>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-3"/>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <serial>2e07e626-cc59-4cbc-8cbc-6f4ee553c82c</serial>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]: </disk>
May 26 05:04:28.726396 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:04:28.766601 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:28.782116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Found WWN 330000000fb1733ce for multipath device dm-10 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:04:28.782333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.047s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:28.785221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] <== connect_volume: return (3047ms) {'type': 'block', 'scsi_wwn': '330000000fb1733ce', 'path': '/dev/dm-10', 'multipath_id': '330000000fb1733ce'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:28.785421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000fb1733ce', 'path': '/dev/dm-10', 'multipath_id': '330000000fb1733ce'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:04:29.220566 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:29.220886 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:29.221165 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:29.278588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.415s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:29.281903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.430s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:29.282096 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:04:29.296284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b7038bb5e2846eaa31929c5b58679c3',ramdisk_id='',reservation_id='r-4m0hffz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1030453916',owner_user_name='tempest-ImageDependencyTests-1030453916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:23Z,user_data=None,user_id='26acfb2a785f4250b6e3eb55c04c89b3',uuid=661946b3-8401-4c5e-a448-d14238a62087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:29.296284 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converting VIF {"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:29.297253 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:29.298069 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lazy-loading 'pci_devices' on Instance uuid 661946b3-8401-4c5e-a448-d14238a62087 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:29.392113 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771869.3917363, 477377b6-cc48-467a-a9a6-d7f2c7be8743 => ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:04:29.392949 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c for instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:04:29.394899 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Successfully detached device vdb from instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 from the live domain config.
May 26 05:04:29.395719 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:04:29.396058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:29.396184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:29.797295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:04:29.798236 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:04:29.798482 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:29.798754 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:29.805265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <uuid>661946b3-8401-4c5e-a448-d14238a62087</uuid>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <name>instance-0000001f</name>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:name>instance-depend-image</nova:name>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:25</nova:creationTime>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:user uuid="26acfb2a785f4250b6e3eb55c04c89b3">tempest-ImageDependencyTests-1030453916-project-member</nova:user>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:project uuid="4b7038bb5e2846eaa31929c5b58679c3">tempest-ImageDependencyTests-1030453916</nova:project>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         <nova:port uuid="117e5611-06eb-476f-82ad-349c67939fb8">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="192.168.233.218" ipVersion="4"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="serial">661946b3-8401-4c5e-a448-d14238a62087</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="uuid">661946b3-8401-4c5e-a448-d14238a62087</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/disk.config"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <alias name="ua-f4da4fe4-8372-42d0-9432-fe86f7391ea5"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-10"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <serial>f4da4fe4-8372-42d0-9432-fe86f7391ea5</serial>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:db:2a:bc"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <target dev="tap117e5611-06"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/console.log" append="off"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:29.805265 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Preparing to wait for external event network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4b7038bb5e2846eaa31929c5b58679c3',ramdisk_id='',reservation_id='r-4m0hffz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ImageDependencyTests-1030453916',owner_user_name='tempest-ImageDependencyTests-1030453916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:23Z,user_data=None,user_id='26acfb2a785f4250b6e3eb55c04c89b3',uuid=661946b3-8401-4c5e-a448-d14238a62087,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converting VIF {"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:29.807543 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:29.808559 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:29.808559 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:29.809736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:29.809736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:29.812143 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:29.812143 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58d5d09e-b2e2-566e-8119-b9ac91478826', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:29.813137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:29.815763 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance destroyed successfully.
May 26 05:04:29.816208 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'resources' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:29.819781 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:29.825798 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:29.826091 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap117e5611-06, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:29.827072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap117e5611-06, col_values=(('qos', UUID('c5fe8fc5-2585-4c07-802e-e081b552de7b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:29.827072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap117e5611-06, col_values=(('external_ids', {'iface-id': '117e5611-06eb-476f-82ad-349c67939fb8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:2a:bc', 'vm-uuid': '661946b3-8401-4c5e-a448-d14238a62087'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:29.829466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:29.840844 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:29.841249 np0000001388 nova-compute[98319]: INFO os_vif [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06')
May 26 05:04:29.870418 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:29.870975 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing instance network info cache due to event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:29.871262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:29.871522 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:29.871603 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:29.884960 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:04:30.300617 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:04:30.319118 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:30.319979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4xxuBfN5XfC8GQ/PmzAL+Sn5BJF4iNyTa2EHq4XkewBnlll0B7YKN7cbLviqRLqEZ7K5GLDh2S5HmHHgPjzj/u68f9SpkPm1a8DM0qrKYGyW50BVrBsiLA3xa1yjRcKQ==',key_name='tempest-keypair-1664079945',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:03:38Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:04:26.705820',shelved_host='np0000001388',shelved_image_id='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:04:30.320246 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:30.320928 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:30.321260 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:04:30.333244 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.333546 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ee8de7-e6, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:30.335170 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.335968 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:30.342867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.343772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.343934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=919acd47-e6ea-48b8-ba25-445e333fda06) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:30.344626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.345654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:30.350280 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:30.355060 np0000001388 nova-compute[98319]: INFO os_vif [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6')
May 26 05:04:30.355986 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Deleting instance files /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72_del
May 26 05:04:30.363213 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Deletion of /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72_del complete
May 26 05:04:30.374948 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.375151 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fa807765-450a-493a-b193-fe0d0fcfcb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.376287 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.377354 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:30.379706 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.380471 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.380819 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 661946b3-8401-4c5e-a448-d14238a62087 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.380819 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:04:30.381018 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:04:30.381183 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1856MB phys_disk=95GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:04:27 up 36 min,  2 users,  load average: 8.54, 7.29, 3.92\n', 'num_instances': '7', 'num_vm_active': '4', 'num_task_None': '5', 'num_os_type_None': '7', 'num_proj_aa950105770e40f29f0967e1eefd8211': '1', 'io_workload': '2', 'num_vm_shelved': '1', 'num_task_shelving_offloading': '1', 'num_proj_b6925a7d36eb4b919388468635037918': '1', 'num_proj_21271255e15b4780a232d67028f62d32': '1', 'num_proj_9b6c6daea7064df7973a1e2e20e2582f': '1', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '2', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_4b7038bb5e2846eaa31929c5b58679c3': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:04:30.426242 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Successfully created port: dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:04:30.782764 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:30.808820 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:04:30.886517 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:30.887521 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:30.956176 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updated VIF entry in instance network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:30.956176 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:30.958449 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Deleted allocations for instance fa807765-450a-493a-b193-fe0d0fcfcb72
May 26 05:04:31.016526 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Successfully updated port: dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:04:31.157089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.760s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:31.157416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:04:31.157573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96a633c9-515b-4164-bd09-2393229fb70b (non-flash)
May 26 05:04:31.186617 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [78] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [79] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: tcp: [82] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-96a633c9-515b-4164-bd09-2393229fb70b (non-flash)
May 26 05:04:31.187100 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', '78'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', '79'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '81'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-96a633c9-515b-4164-bd09-2393229fb70b', '82')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:04:31.187100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', '78')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:31.188208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c', '79')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:31.189130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ae41f2520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:04:31.189330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Removing multipathed devices sde, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:04:31.189544 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Flush multipath device 330000000f945ecf2 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:04:31.222464 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:31.266545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:31.273270 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:31.273853 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing instance network info cache due to event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:31.274319 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] Acquiring lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:31.274458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] Acquired lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:31.274630 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing network info cache for port dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:31.319536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Checking to see if SCSI volumes sde, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:04:31.319667 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] SCSI volumes sde, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:04:31.320922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Checking to see if device paths {'sde', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:04:31.335641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Device paths {'sde', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:04:31.336009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:04:31.348088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.364814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:31.364924 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:31.365210 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] No VIF found with MAC fa:16:3e:db:2a:bc, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:31.365427 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Using config drive
May 26 05:04:31.394142 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:31.399919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 78, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.40.100,3260]
May 26 05:04:31.399919 np0000001388 nova-compute[98319]: Logout of [sid: 78, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.40.100,3260] successful.
May 26 05:04:31.399919 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.422871 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.438510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.465576 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-610a8dbb-cbe0-44f6-a892-67d5f8b844c8 req-5159c1d8-77cc-4497-bd99-29edb4950b2a service nova] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:31.466584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:31.485555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 79, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.50.100,3260]
May 26 05:04:31.485555 np0000001388 nova-compute[98319]: Logout of [sid: 79, target: iqn.2023-03.storpool.com:os--volume-2e07e626-cc59-4cbc-8cbc-6f4ee553c82c, portal: 192.168.50.100,3260] successful.
May 26 05:04:31.485555 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.511045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:31.511899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:31.512064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] <== disconnect_volume: return (2115ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:31.512231 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:04:31.519585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:31.777277 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:31.816773 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:04:31.817681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:31.818095 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Creating image(s)
May 26 05:04:31.818290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:31.818435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:31.818778 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:31.819402 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:31.821877 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:31.822972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:31.846043 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:31.876124 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:31.905972 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:04:31.906612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.628s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:31.907101 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:31.908461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.441s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:31.930188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:31.931868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:31.932288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:31.932704 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:31.935541 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:31.935908 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:32.042084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:32.042599 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:32.075063 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:32.119497 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lazy-loading 'flavor' on Instance uuid 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:32.130876 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Creating config drive at /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/disk.config
May 26 05:04:32.131670 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk 1073741824" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:32.132045 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:32.135170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:32.167873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.178617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkk3w2akw {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:32.240969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:32.242116 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:04:32.243131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:32.267073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkk3w2akw" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:32.356722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:32.357670 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:04:32.357670 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:04:32.357905 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Ensure instance console log exists: /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:32.358273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:32.359340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:32.359340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:32.459310 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:32.459927 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:32.581184 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-264d37be-2503-410f-b1f5-09d4c2bdbf10 req-c66e8769-4ed0-442f-8007-27020c32a256 service nova] Releasing lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:32.581782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:32.582042 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:32.778696 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.853245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.857917 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.867448 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.907034 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:04:32.907083 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:04:32.908230 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.71 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:04:32.921804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:32.963460 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:33.136565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7fd384aa-07ea-4067-a796-04b459ffeaeb tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.994s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:33.209745 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:33.226529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:33.228449 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:33.231921 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:33.254615 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:33.361395 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fa41a6b2-bed5-4baf-ad6f-265cd9f7673b req-4a763066-d754-40d8-a2f6-ac5bb4eb12cb service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:33.363401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa41a6b2-bed5-4baf-ad6f-265cd9f7673b req-4a763066-d754-40d8-a2f6-ac5bb4eb12cb service nova] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:33.363401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa41a6b2-bed5-4baf-ad6f-265cd9f7673b req-4a763066-d754-40d8-a2f6-ac5bb4eb12cb service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:33.363401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa41a6b2-bed5-4baf-ad6f-265cd9f7673b req-4a763066-d754-40d8-a2f6-ac5bb4eb12cb service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:33.363401 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fa41a6b2-bed5-4baf-ad6f-265cd9f7673b req-4a763066-d754-40d8-a2f6-ac5bb4eb12cb service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Processing event network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:33.448507 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:33.474086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.566s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:33.484812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:33.559662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:33.559822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:33.559890 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:33.560029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:33.560104 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:33.563094 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Terminating instance
May 26 05:04:33.625283 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating instance_info_cache with network_info: [{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:33.839548 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771873.8388913, 661946b3-8401-4c5e-a448-d14238a62087 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:33.840214 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:33.840214 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] VM Started (Lifecycle Event)
May 26 05:04:33.843233 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:33.846358 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Instance spawned successfully.
May 26 05:04:33.848090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:33.980138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e073164-206d-4a62-85e3-75a47321a925 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 14.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:33.982359 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.496s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:33.982359 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Unshelving
May 26 05:04:34.068650 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:04:34.094064 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.098450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.124677 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.131686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:34.132359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance network_info: |[{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:04:34.137667 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Start _get_guest_xml network_info=[{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:34.143479 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:34.148193 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='21be2726-991c-4d86-971a-d2033d23977b'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771874.147557) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:34.155410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.155538 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.157639 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:34.157639 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:34.160290 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:34.160641 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:34.162690 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:34.162690 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:34.162690 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:34.163809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:34.163809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:34.163809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:34.163809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:34.164116 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:34.164272 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:34.164455 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:34.164795 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:34.165256 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:34.178907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=32,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-u60h5m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=21be2726-991c-4d86-971a-d2033d23977b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:34.179167 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:34.182350 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:34.182350 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:34.305580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:34.306386 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:34.306558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:34.306670 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:34.306803 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] No waiting events found dispatching network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:34.306916 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f00dfe6f-cafb-46cf-bc4b-49211cf15e43 req-0da27bf1-7172-4e6b-8f37-9f607f87bc57 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:34.345664 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:34.351675 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.359301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:34.417474 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Instance destroyed successfully.
May 26 05:04:34.417791 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lazy-loading 'resources' on Instance uuid 477377b6-cc48-467a-a9a6-d7f2c7be8743 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:34.684348 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <uuid>21be2726-991c-4d86-971a-d2033d23977b</uuid>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <name>instance-00000020</name>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:34</nova:creationTime>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         <nova:port uuid="dc13fc7e-fb16-41c7-864b-b68f89d55b7e">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="serial">21be2726-991c-4d86-971a-d2033d23977b</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="uuid">21be2726-991c-4d86-971a-d2033d23977b</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.config"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:22:1b:83"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <target dev="tapdc13fc7e-fb"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/console.log" append="off"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:34.684348 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Preparing to wait for external event network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=32,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-u60h5m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=21be2726-991c-4d86-971a-d2033d23977b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:34.686559 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:34.686862 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:34.687316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.687626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.687840 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:34.688813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.688813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a7879730-1f5e-5661-b8d1-0b38120769f9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.691532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.691532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:34.697459 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.699419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.699613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdc13fc7e-fb, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.699939 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdc13fc7e-fb, col_values=(('qos', UUID('5b44a962-6fe4-4056-901a-044c38e050ec')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.700145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdc13fc7e-fb, col_values=(('external_ids', {'iface-id': 'dc13fc7e-fb16-41c7-864b-b68f89d55b7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:1b:83', 'vm-uuid': '21be2726-991c-4d86-971a-d2033d23977b'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.701283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.702482 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:34.714822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.715093 np0000001388 nova-compute[98319]: INFO os_vif [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb')
May 26 05:04:34.858697 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:34.858697 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771874.8559198, 661946b3-8401-4c5e-a448-d14238a62087 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:34.858697 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] VM Paused (Lifecycle Event)
May 26 05:04:34.863389 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Took 9.28 seconds to spawn the instance on the hypervisor.
May 26 05:04:34.863522 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:34.920227 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesExtendAttachedTest-instance-1899204431',display_name='tempest-VolumesExtendAttachedTest-instance-1899204431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesextendattachedtest-instance-1899204431',id=26,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZmncgNQjyvYzaaxEZU+qC9SWYahj5bLj/r79tml2hisobffHeo2e5zc6gGIOXDe893p1oXI+emkF+4Uqu4Kp0bLWyTDEtJ3fOZ1N4TvEQGrNuHaC2tgur4Pq5nYjYzGw==',key_name='tempest-keypair-829574181',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:03:35Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa950105770e40f29f0967e1eefd8211',ramdisk_id='',reservation_id='r-umnrvmek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesExtendAttachedTest-1174418108',owner_user_name='tempest-VolumesExtendAttachedTest-1174418108-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1d031958ee54c7c91fff69e00d93a73',uuid=477377b6-cc48-467a-a9a6-d7f2c7be8743,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:04:34.920567 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converting VIF {"id": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "address": "fa:16:3e:65:7d:be", "network": {"id": "43e67e38-87b3-43e5-a555-5101224d6314", "bridge": "br-int", "label": "tempest-VolumesExtendAttachedTest-1720513569-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "aa950105770e40f29f0967e1eefd8211", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1cd2bd8-9a", "ovs_interfaceid": "d1cd2bd8-9a23-4af8-8c22-084c4b0d5850", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:34.921558 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:34.921796 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:04:34.922945 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.923597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1cd2bd8-9a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.924618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.925618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:34.931729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.932637 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.932813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=de453c40-2436-453d-946d-cc446070c81e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:34.933437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.934545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:34.940306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:34.942520 np0000001388 nova-compute[98319]: INFO os_vif [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:7d:be,bridge_name='br-int',has_traffic_filtering=True,id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850,network=Network(43e67e38-87b3-43e5-a555-5101224d6314),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1cd2bd8-9a')
May 26 05:04:34.942782 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Deleting instance files /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743_del
May 26 05:04:34.943591 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Deletion of /opt/stack/data/nova/instances/477377b6-cc48-467a-a9a6-d7f2c7be8743_del complete
May 26 05:04:35.361293 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:35.363961 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771875.3627887, 661946b3-8401-4c5e-a448-d14238a62087 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:35.363961 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] VM Resumed (Lifecycle Event)
May 26 05:04:35.375708 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Took 16.60 seconds to build instance.
May 26 05:04:35.427532 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:35.428043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:35.428484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:35.428484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:35.428862 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] No waiting events found dispatching network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:35.428862 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-4c63857e-b065-40c2-9313-040078e4adf2 req-ce442a69-2479-44bd-8edc-ef55d5fa2a3f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received unexpected event network-vif-plugged-117e5611-06eb-476f-82ad-349c67939fb8 for instance with vm_state active and task_state None.
May 26 05:04:35.449373 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Took 1.38 seconds to destroy the instance on the hypervisor.
May 26 05:04:35.450043 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:04:35.450318 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:04:35.450436 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:04:35.450670 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:35.499800 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Booting with volume d3853de5-4e14-4a6f-927b-43d6c6b3f160 at /dev/vdc
May 26 05:04:35.560712 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:35.577638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:04:35.591501 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:35.602954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:35.644280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:04:35.644609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:04:35.657358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:04:35.658495 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec5:80bc', 'fe80::b881:84ff:fe80:e951', 'fe80::fc16:3eff:fe08:3560', 'fe80::c08b:afff:fe43:df92', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fedb:2abc', 'fe80::7cf8:f7ff:fe11:5704'] 
May 26 05:04:35.658623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:04:35.658757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:04:35.659067 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:35.659336 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating existing volume attachment record: fd55d29e-3b37-440f-a574-023bc93e6270 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:04:35.867053 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:35.869638 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:35.878379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7507a5-e811-44cf-9406-1df72c59b482 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.104s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:36.172491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f392d15-b52f-4cf8-914e-9ad26a8a867c req-b13772fc-a1f6-41a7-b7bb-d8e0bf6dba7e service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-deleted-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:36.172927 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-1f392d15-b52f-4cf8-914e-9ad26a8a867c req-b13772fc-a1f6-41a7-b7bb-d8e0bf6dba7e service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Neutron deleted interface d1cd2bd8-9a23-4af8-8c22-084c4b0d5850; detaching it from the instance and deleting it from the info cache
May 26 05:04:36.173085 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1f392d15-b52f-4cf8-914e-9ad26a8a867c req-b13772fc-a1f6-41a7-b7bb-d8e0bf6dba7e service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:36.233910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:36.234151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:36.234785 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:22:1b:83, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:36.234899 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Using config drive
May 26 05:04:36.371734 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:36.372126 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] Acquiring lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:36.372655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:36.372655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:36.373259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] No waiting events found dispatching network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:36.373259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f33f51bb-a630-41d2-9f48-fe07dfb6e7f3 req-40893321-4531-48c2-88a8-be0080a2f510 service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Received event network-vif-unplugged-d1cd2bd8-9a23-4af8-8c22-084c4b0d5850 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:36.374757 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999616156999764 future=<Future at 0x7d7ac432c380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:36.602362 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:36.676257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f392d15-b52f-4cf8-914e-9ad26a8a867c req-b13772fc-a1f6-41a7-b7bb-d8e0bf6dba7e service nova] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Detach interface failed, port_id=d1cd2bd8-9a23-4af8-8c22-084c4b0d5850, reason: Instance 477377b6-cc48-467a-a9a6-d7f2c7be8743 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:04:36.740898 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:36.885713 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Creating config drive at /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.config
May 26 05:04:36.890844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpryvyi0r2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:36.954464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpryvyi0r2" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:37.106821 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Took 1.66 seconds to deallocate network for instance.
May 26 05:04:37.168907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.352838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:37.353359 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:37.354628 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_requests' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:37.419604 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005826960000376857 future=<Future at 0x7d7aa43a2e10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:37.420132 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:37.420132 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=13.954401360999782 future=<Future at 0x7d7ac432c380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:37.420132 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=13.954296245999558 future=<Future at 0x7d7ac432c380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:37.421851 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Emitting event <LifecycleEvent: 1779771862.4188693, fa807765-450a-493a-b193-fe0d0fcfcb72 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:37.422081 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Stopped (Lifecycle Event)
May 26 05:04:37.478640 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.507410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.511260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.621587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:37.621806 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.691433 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.692400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.812364 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:37.859699 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'numa_topology' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:37.925950 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:38.322046 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:38.325081 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:38.325314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:38.326042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:38.326042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Processing event network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:38.326042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:38.326042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:38.326254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:38.327617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:38.327795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] No waiting events found dispatching network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:38.328054 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-845626a8-9248-4920-9e88-1aed70ca49f7 req-d63dd53d-03be-4bc6-ac08-f2b9dbeb3626 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received unexpected event network-vif-plugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e for instance with vm_state building and task_state spawning.
May 26 05:04:38.362566 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:38.362815 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Claim successful on node np0000001388
May 26 05:04:38.487655 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:38.488676 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771878.4878793, 21be2726-991c-4d86-971a-d2033d23977b => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:38.488897 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] VM Started (Lifecycle Event)
May 26 05:04:38.491648 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:38.494825 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance spawned successfully.
May 26 05:04:38.497082 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:38.993180 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:38.995328 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.006234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:39.498919 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:39.499443 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771879.499004, 21be2726-991c-4d86-971a-d2033d23977b => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:39.499443 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] VM Paused (Lifecycle Event)
May 26 05:04:39.512539 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Took 7.70 seconds to spawn the instance on the hypervisor.
May 26 05:04:39.512836 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:39.792157 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:39.792413 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:39.933813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:40.003875 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:40.005250 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771880.0050733, 21be2726-991c-4d86-971a-d2033d23977b => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:40.005360 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] VM Resumed (Lifecycle Event)
May 26 05:04:40.025298 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Took 13.23 seconds to build instance.
May 26 05:04:40.298995 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:40.507664 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:40.512360 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:40.526933 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d8537de-3a8b-438e-9d45-8993d4e8573e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.744s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:40.812167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.459s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:40.812568 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:40.814846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.193s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:40.907076 np0000001388 nova-compute[98319]: INFO nova.network.neutron [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating port b7ee8de7-e65c-4b0f-b64a-2af100a06510 with attributes {'binding:host_id': 'np0000001388', 'device_owner': 'compute:nova'}
May 26 05:04:40.916594 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:40.916797 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing instance network info cache due to event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:40.917021 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] Acquiring lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:40.917156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] Acquired lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:40.917358 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing network info cache for port dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:41.096514 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:41.096705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:41.096925 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:41.097081 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:41.097224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:41.102015 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Terminating instance
May 26 05:04:41.259402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:41.259619 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:41.419565 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:41.474444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:41.474573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:41.474696 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:41.529002 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:41.529453 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing instance network info cache due to event network-changed-b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:41.529453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] Acquiring lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:41.608236 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:04:41.634270 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.635962 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.662766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.671524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.697150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.698826 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:41.763576 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:41.825508 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:41.834456 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:41.836494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:41.836674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:41.836796 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:41.836957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] No waiting events found dispatching network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:41.837087 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff8114ef-1232-4a8a-93e7-7879cd55de7b req-04de56a5-94c8-4eeb-83f6-bb3a6177746e service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:41.938340 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999639259000105 future=<Future at 0x7d7aa4229dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:41.943138 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Instance destroyed successfully.
May 26 05:04:41.943739 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lazy-loading 'resources' on Instance uuid 661946b3-8401-4c5e-a448-d14238a62087 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:41.970632 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updated VIF entry in instance network info cache for port dc13fc7e-fb16-41c7-864b-b68f89d55b7e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:41.970960 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating instance_info_cache with network_info: [{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:41.977775 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:42.171177 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.260948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:42.261270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:42.277028 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.462s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:42.306494 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:42.347905 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Deleted allocations for instance 477377b6-cc48-467a-a9a6-d7f2c7be8743
May 26 05:04:42.446174 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:04:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='instance-depend-image',display_name='instance-depend-image',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='instance-depend-image',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:34Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4b7038bb5e2846eaa31929c5b58679c3',ramdisk_id='',reservation_id='r-4m0hffz7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-ImageDependencyTests-1030453916',owner_user_name='tempest-ImageDependencyTests-1030453916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:35Z,user_data=None,user_id='26acfb2a785f4250b6e3eb55c04c89b3',uuid=661946b3-8401-4c5e-a448-d14238a62087,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:04:42.446624 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converting VIF {"id": "117e5611-06eb-476f-82ad-349c67939fb8", "address": "fa:16:3e:db:2a:bc", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.218", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap117e5611-06", "ovs_interfaceid": "117e5611-06eb-476f-82ad-349c67939fb8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:42.447371 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:42.447737 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:04:42.449020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.449376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap117e5611-06, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:42.450301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.451118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:42.452441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.453088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.453224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5fe8fc5-2585-4c07-802e-e081b552de7b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:42.454644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:42.455298 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:42.458475 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:42.458857 np0000001388 nova-compute[98319]: INFO os_vif [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:2a:bc,bridge_name='br-int',has_traffic_filtering=True,id=117e5611-06eb-476f-82ad-349c67939fb8,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap117e5611-06')
May 26 05:04:42.460514 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:04:42.460870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:42.461125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:42.461546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:42.461913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f4da4fe4-8372-42d0-9432-fe86f7391ea5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:04:42.462190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:04:42.473438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f4f6fb3-aeb0-421f-9fa7-f0916b51c441 req-f42afb9b-b040-4702-b08c-532b4163568e service nova] Releasing lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:42.490507 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [80] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]: tcp: [81] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5 (non-flash)
May 26 05:04:42.490920 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:42.491631 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '80'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '81')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:04:42.491856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '81')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:42.492850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5', '80')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:42.493701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4309f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'): ({'sdk'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:04:42.493995 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Removing multipathed devices sdd, sdk {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:04:42.494332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Flush multipath device 330000000fb1733ce {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:04:42.523841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:42.567914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:42.604226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Checking to see if SCSI volumes sdd, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:04:42.604226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] SCSI volumes sdd, sdk have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:04:42.604226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Checking to see if device paths {'sdd', 'sdk'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:04:42.615428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Device paths {'sdd', 'sdk'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:04:42.615918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:04:42.626392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.657295 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 81, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.40.100,3260]
May 26 05:04:42.657295 np0000001388 nova-compute[98319]: Logout of [sid: 81, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.40.100,3260] successful.
May 26 05:04:42.657295 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.674709 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.685694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.718625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 80, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.50.100,3260]
May 26 05:04:42.718625 np0000001388 nova-compute[98319]: Logout of [sid: 80, target: iqn.2023-03.storpool.com:os--volume-f4da4fe4-8372-42d0-9432-fe86f7391ea5, portal: 192.168.50.100,3260] successful.
May 26 05:04:42.718625 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.739453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:42.742228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:42.742228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] <== disconnect_volume: return (279ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:42.742228 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:04:42.742228 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Deleting instance files /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087_del
May 26 05:04:42.742228 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Deletion of /opt/stack/data/nova/instances/661946b3-8401-4c5e-a448-d14238a62087_del complete
May 26 05:04:42.769072 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:04:42.961330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:42.961728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:42.961972 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating image(s)
May 26 05:04:42.962492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:42.962657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:42.963253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:42.963395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] Acquired lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:42.963537 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Refreshing network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:42.964576 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:43.248965 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Took 1.64 seconds to destroy the instance on the hypervisor.
May 26 05:04:43.249615 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:04:43.249990 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:04:43.250094 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:04:43.250363 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:43.327715 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:43.327879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:43.331540 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:04:43.331662 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Claim successful on node np0000001388
May 26 05:04:43.356735 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-84f18d95-0238-4008-96b2-401e5623d356 tempest-VolumesExtendAttachedTest-1174418108 tempest-VolumesExtendAttachedTest-1174418108-project-member] Lock "477377b6-cc48-467a-a9a6-d7f2c7be8743" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.797s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:43.362213 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:43.465837 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:43.467360 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:43.467633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:43.468010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:43.898408 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:43.908887 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:43.909729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] Acquiring lock "661946b3-8401-4c5e-a448-d14238a62087-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:43.909969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:43.910148 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] Lock "661946b3-8401-4c5e-a448-d14238a62087-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:43.913630 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] No waiting events found dispatching network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:43.913818 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-unplugged-117e5611-06eb-476f-82ad-349c67939fb8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:43.917312 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Received event network-vif-deleted-117e5611-06eb-476f-82ad-349c67939fb8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:43.918123 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Neutron deleted interface 117e5611-06eb-476f-82ad-349c67939fb8; detaching it from the instance and deleting it from the info cache
May 26 05:04:43.918316 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:44.016480 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:44.016756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:44.017056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:44.017216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:44.017393 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:44.019526 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Terminating instance
May 26 05:04:44.078763 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updated VIF entry in instance network info cache for port b7ee8de7-e65c-4b0f-b64a-2af100a06510. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:44.079054 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:44.139868 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:44.406974 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.411368 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.411790 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:44.438308 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9194b24d-21e3-4e6b-8ce4-82a0bf3e4a40 req-163bd851-8c48-40c3-a57f-74837d67510f service nova] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Detach interface failed, port_id=117e5611-06eb-476f-82ad-349c67939fb8, reason: Instance 661946b3-8401-4c5e-a448-d14238a62087 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:04:44.512997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.part --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:44.513449 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] 7ff1e98c-dc9e-43fd-9fed-b66fcde744ed was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:04:44.516301 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:04:44.516866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.part /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:44.544857 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:04:44.583114 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:44.586891 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ee8f874-1e30-46cb-9b3b-a96bd014d8b0 req-fd2c52e3-662d-4b9e-9ecd-72376264825c service nova] Releasing lock "refresh_cache-fa807765-450a-493a-b193-fe0d0fcfcb72" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:44.592420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:44.599075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:44.621444 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:44.628207 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:44.643627 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Took 1.39 seconds to deallocate network for instance.
May 26 05:04:44.737381 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:44.740210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:44.740210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:44.740210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:44.740395 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] No waiting events found dispatching network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:44.740639 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-691fc9fa-9f1f-436d-a7a4-208e5841ece9 req-82d6f401-45e3-4f25-933b-8ad2418b04c0 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:44.773968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.part /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.converted" returned: 0 in 0.257s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:44.789450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:44.850056 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:44.850458 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:44.887862 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99962156699985 future=<Future at 0x7d7aec0d6180 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:44.889549 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Instance destroyed successfully.
May 26 05:04:44.890085 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lazy-loading 'resources' on Instance uuid 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:44.893072 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a.converted --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:44.893644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.426s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:44.894064 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.897228 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.898645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:44.984694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:44.985093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:44.985568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:44.985938 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.988452 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:44.988805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:45.080349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:45.080826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a,backing_fmt=raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:45.126901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a,backing_fmt=raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk 1073741824" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:45.127457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "a8442da306549f1cb7b42705c1c21fd0f12c375a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:45.127844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:45.198422 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:04:45.201593 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Deleting volume: f4da4fe4-8372-42d0-9432-fe86f7391ea5 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:04:45.213443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8442da306549f1cb7b42705c1c21fd0f12c375a --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:45.213876 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'migration_context' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:45.355107 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:45.392686 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-instance-2110617468',display_name='tempest-instance-2110617468',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-instance-2110617468',id=28,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCQPNQ2/c/fzf/N6cIPZ4IAwaanBbFFjhO9H+F7HHXrkty/IRG6YILNDQNs0cjqO16l/xYbuoRieJTn4DmJdluy/cm9BuZ48JjdNNEWsjV6GPdPE9LMxvOQXY6Qk1w6IRw==',key_name='tempest-keypair-96877500',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21271255e15b4780a232d67028f62d32',ramdisk_id='',reservation_id='r-v2xm8wpt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-355836651',owner_user_name='tempest-VolumesBackupsTest-355836651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='34b4ac452e8c430695b189e1083a0c68',uuid=0ab1ef45-6ef4-4886-8f22-9d2c4c8af777,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:04:45.393041 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converting VIF {"id": "0959a8ad-26da-4a87-9979-27832a4913eb", "address": "fa:16:3e:c5:80:bc", "network": {"id": "9e127e2f-0d47-488d-a041-9074fd65dc61", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-258958859-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "21271255e15b4780a232d67028f62d32", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0959a8ad-26", "ovs_interfaceid": "0959a8ad-26da-4a87-9979-27832a4913eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:45.394019 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:45.394273 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:04:45.395584 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:45.395934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0959a8ad-26, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:45.397432 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:45.398558 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:45.399046 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:45.400463 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:45.400611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a71aa6e8-249e-4b27-ba52-111bddc2fecb) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:45.401999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:45.404447 np0000001388 nova-compute[98319]: INFO os_vif [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:80:bc,bridge_name='br-int',has_traffic_filtering=True,id=0959a8ad-26da-4a87-9979-27832a4913eb,network=Network(9e127e2f-0d47-488d-a041-9074fd65dc61),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0959a8ad-26')
May 26 05:04:45.408030 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:04:45.408450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:45.408588 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:45.409025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:45.411084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:04:45.411249 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:45.442903 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsi session list stdout=tcp: [69] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: tcp: [70] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:45.443225 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:45.443370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '69'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '70'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:04:45.443510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '69')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:45.444786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '70')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:04:45.445813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa45889a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:04:45.446105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:04:45.446556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Flush multipath device 330000000ee07962a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:04:45.508973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:45.554133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:04:45.603534 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:04:45.603749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:04:45.605027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:04:45.622298 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:04:45.622526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:04:45.633985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.669752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.40.100,3260]
May 26 05:04:45.669752 np0000001388 nova-compute[98319]: Logout of [sid: 69, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.40.100,3260] successful.
May 26 05:04:45.669752 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.693229 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.707756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.718553 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:45.718953 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Rebasing disk image.
May 26 05:04:45.719115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:45.747485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:45.748480 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.50.100,3260]
May 26 05:04:45.748480 np0000001388 nova-compute[98319]: Logout of [sid: 70, target: iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7, portal: 192.168.50.100,3260] successful.
May 26 05:04:45.748480 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.768225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:45.768767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:45.769316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] <== disconnect_volume: return (360ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:45.769316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:04:45.769800 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Deleting instance files /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777_del
May 26 05:04:45.770609 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Deletion of /opt/stack/data/nova/instances/0ab1ef45-6ef4-4886-8f22-9d2c4c8af777_del complete
May 26 05:04:45.834062 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:45.834776 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d -F raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:45.868439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:45.869640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.123s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:45.870363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:04:46.281912 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:46.282287 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:46.283403 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Took 1.74 seconds to destroy the instance on the hypervisor.
May 26 05:04:46.284878 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:04:46.286826 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:04:46.286826 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:04:46.286826 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:46.379347 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:04:46.379532 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:04:46.379842 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:46.380096 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:46.425159 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:46.470171 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:04:46.756213 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d -F raw /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk" returned: 0 in 0.921s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:46.757169 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:04:46.757169 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Ensure instance console log exists: /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:46.757499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:46.757775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:46.758039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:46.761689 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start _get_guest_xml network_info=[{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='90baa84d43be04870cf6c5bb4e5c9980',container_format='bare',created_at=2026-05-26T05:04:19Z,direct_url=<?>,disk_format='qcow2',id=7ff1e98c-dc9e-43fd-9fed-b66fcde744ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-459121262-shelved',owner='b6925a7d36eb4b919388468635037918',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-05-26T05:04:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdc', 'delete_on_termination': False, 'attachment_id': 'fd55d29e-3b37-440f-a574-023bc93e6270', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': 'fa807765-450a-493a-b193-fe0d0fcfcb72', 'attached_at': '', 'detached_at': '', 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'serial': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:46.770020 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:46.771460 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-459121262', uuid='fa807765-450a-493a-b193-fe0d0fcfcb72'), owner=OwnerMeta(userid='fdb1ab2deb1f45f3a5cb5374e0e8dea1', username='tempest-AttachVolumeShelveTestJSON-946543145-project-member', projectid='b6925a7d36eb4b919388468635037918', projectname='tempest-AttachVolumeShelveTestJSON-946543145'), image=ImageMeta(id='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771886.7710683) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:46.773234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:46.774111 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:46.775177 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:46.775788 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:46.777114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:46.778002 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='90baa84d43be04870cf6c5bb4e5c9980',container_format='bare',created_at=2026-05-26T05:04:19Z,direct_url=<?>,disk_format='qcow2',id=7ff1e98c-dc9e-43fd-9fed-b66fcde744ed,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-459121262-shelved',owner='b6925a7d36eb4b919388468635037918',properties=ImageMetaProps,protected=<?>,size=54067200,status='active',tags=<?>,updated_at=2026-05-26T05:04:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:46.778260 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:46.778461 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:46.778882 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:46.779021 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:46.779167 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:46.779433 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:46.779621 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:46.779829 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:46.780017 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:46.780453 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:46.780673 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:46.787057 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:46.841166 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:46.841517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] Acquiring lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:46.841736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:46.842339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:46.842530 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] No waiting events found dispatching network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:46.842707 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6e0f1b76-9e40-4555-92d7-2df165cf4b8a req-6f7c1e42-1a24-4a70-b48d-367009751d20 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-unplugged-0959a8ad-26da-4a87-9979-27832a4913eb for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:04:46.883221 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:04:47.173417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:47.285292 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:47.297073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.428s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:47.301342 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:04:47.301701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:04:47.301947 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:47.302332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:47.302686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:04:47.314719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:47.315124 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:47.315363 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:47.316371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:04:47.319186 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:04:47.319484 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:47.327575 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:47.327575 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:47.332891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:04:47.332891 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:47.344671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160] added
May 26 05:04:47.344671 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:47.344671 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:47.344671 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:47.344671 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:47.344671 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:47.344671 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:47.345025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:47.345025 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0296(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:47.345189 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:47.347261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160] added
May 26 05:04:47.347261 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:04:47.347261 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:47.347261 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:47.347261 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:04:47.347261 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:04:47.347261 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:47.347483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:04:47.347483 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:04:47.347637 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:04:47.381102 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Deleted allocations for instance 661946b3-8401-4c5e-a448-d14238a62087
May 26 05:04:47.386849 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:04:47.413593 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:47.562469 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Successfully created port: 5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:04:47.915658 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Took 1.63 seconds to deallocate network for instance.
May 26 05:04:48.079445 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:48.109313 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Successfully updated port: 5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:04:48.345652 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:04:48.348142 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:48.370341 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:48.370341 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:04:48.379263 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:04:48.379263 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.391310 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e08d21d-f9b4-4b65-9116-f81a8d2f3134 tempest-ImageDependencyTests-1030453916 tempest-ImageDependencyTests-1030453916-project-member] Lock "661946b3-8401-4c5e-a448-d14238a62087" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.293s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:48.391653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.394480 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.408542 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:04:48.409229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:04:48.409545 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Creating image(s)
May 26 05:04:48.412340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:48.412691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:48.413808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.413808 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.413808 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.413808 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.413808 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:48.414036 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsi session list stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.414036 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.414036 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.414036 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.414036 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:48.415042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:48.417335 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:48.425171 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:48.427421 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.427421 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.427421 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.427421 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.427421 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:48.427630 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsi session list stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.427630 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.427630 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.427630 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.427630 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:48.430107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:48.462464 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.40.100,3260]
May 26 05:04:48.462464 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.40.100,3260] successful.
May 26 05:04:48.462464 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.469554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.50.100,3260]
May 26 05:04:48.469554 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.50.100,3260] successful.
May 26 05:04:48.469554 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.479340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.484415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsi session list stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.502356 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:48.503815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.188s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:48.503815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:48.504210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] HCTL ('7', '-', '-', 0) found on session 83 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:48.508332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:48.510244 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Took 0.59 seconds to detach 1 volumes for instance.
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.512602 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsi session list stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:04:48.513778 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:04:48.514332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:48.515312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:04:48.521586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] HCTL ('8', '-', '-', 0) found on session 84 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:04:48.521840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:04:48.536747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching for a device in session 83 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:48.538069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:48.547112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching for a device in session 84 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:04:48.547112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:04:48.552943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:48.552943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:48.553358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:48.554387 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:48.560686 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:04:48.561445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:48.612741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:48.613650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:48.613934 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:04:48.678319 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:48.680106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:48.755845 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk 1073741824" returned: 0 in 0.076s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:48.757631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:48.758281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:48.872239 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:48.872773 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:04:48.873798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:48.948450 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Received event network-vif-deleted-0959a8ad-26da-4a87-9979-27832a4913eb {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:48.948886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:48.948970 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing instance network info cache due to event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:48.949211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] Acquiring lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:48.988818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:48.989260 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:04:48.989641 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:04:48.989831 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Ensure instance console log exists: /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:04:48.990145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:48.990538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:48.990617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:49.021626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:49.021868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:49.214596 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:04:49.317649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:04:49.415822 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:49.447635 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:04:49.447918 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:04:49.587607 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating instance_info_cache with network_info: [{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:49.951394 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:04:50.090684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:50.091135 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Instance network_info: |[{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:04:50.093050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Start _get_guest_xml network_info=[{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:04:50.093439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] Acquired lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:50.093636 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:50.098170 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:04:50.099685 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='a921deec-f5fe-4c81-a5c2-df30f947a826'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771890.0991838) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:04:50.104655 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:04:50.105345 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:04:50.108602 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:04:50.108806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:04:50.110636 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:04:50.111001 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:04:50.111179 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:04:50.111319 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:04:50.111449 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:04:50.111545 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:04:50.111647 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:04:50.111789 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:04:50.111900 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:04:50.112157 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:04:50.112526 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:04:50.112651 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:04:50.125132 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=33,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-a26ekxzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=a921deec-f5fe-4c81-a5c2-df30f947a826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:50.125368 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:50.126208 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:50.126817 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:50.335000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Found WWN 330000000c643fdbd for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:04:50.335387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:04:50.335562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000c643fdbd', 'path': '/dev/dm-0', 'multipath_id': '330000000c643fdbd'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:04:50.335857 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c643fdbd', 'path': '/dev/dm-0', 'multipath_id': '330000000c643fdbd'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:04:50.336049 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.401392 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.459779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.438s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:50.537414 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Deleted allocations for instance 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777
May 26 05:04:50.598457 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:50.629345 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <uuid>a921deec-f5fe-4c81-a5c2-df30f947a826</uuid>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <name>instance-00000021</name>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:50</nova:creationTime>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         <nova:port uuid="5decd3eb-d9e7-472e-b37b-ac70248fe91b">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="serial">a921deec-f5fe-4c81-a5c2-df30f947a826</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="uuid">a921deec-f5fe-4c81-a5c2-df30f947a826</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.config"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ea:3c:2e"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <target dev="tap5decd3eb-d9"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/console.log" append="off"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:50.629345 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Preparing to wait for external event network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=33,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-a26ekxzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=a921deec-f5fe-4c81-a5c2-df30f947a826,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:50.632979 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.633674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:50.633674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:50.634141 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.634307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39d45a81-df41-55ca-b8ac-1a415449feb1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:50.635106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.635839 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:50.637333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.642220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.642220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5decd3eb-d9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:50.642220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5decd3eb-d9, col_values=(('qos', UUID('ff23258f-4a00-4998-a05c-11728624d38c')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:50.642421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5decd3eb-d9, col_values=(('external_ids', {'iface-id': '5decd3eb-d9e7-472e-b37b-ac70248fe91b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:3c:2e', 'vm-uuid': 'a921deec-f5fe-4c81-a5c2-df30f947a826'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:50.643309 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.644718 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:50.651267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:50.651267 np0000001388 nova-compute[98319]: INFO os_vif [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9')
May 26 05:04:50.842221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1664079945',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:03:38Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:04:26.705820',shelved_host='np0000001388',shelved_image_id='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:04:50.842221 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:50.842690 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:50.843544 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_devices' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:50.904652 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:51.055568 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updated VIF entry in instance network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:51.055805 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating instance_info_cache with network_info: [{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:51.347956 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:51.350533 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] End _get_guest_xml xml=<domain type="qemu">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <uuid>fa807765-450a-493a-b193-fe0d0fcfcb72</uuid>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <name>instance-0000001b</name>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-459121262</nova:name>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:04:46</nova:creationTime>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:user uuid="fdb1ab2deb1f45f3a5cb5374e0e8dea1">tempest-AttachVolumeShelveTestJSON-946543145-project-member</nova:user>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:project uuid="b6925a7d36eb4b919388468635037918">tempest-AttachVolumeShelveTestJSON-946543145</nova:project>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         <nova:port uuid="b7ee8de7-e65c-4b0f-b64a-2af100a06510">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <system>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="serial">fa807765-450a-493a-b193-fe0d0fcfcb72</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="uuid">fa807765-450a-493a-b193-fe0d0fcfcb72</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </system>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <os>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </os>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <features>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </features>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   <devices>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <alias name="ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <target dev="vdc" bus="virtio"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <serial>d3853de5-4e14-4a6f-927b-43d6c6b3f160</serial>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </disk>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b8:9a:c3"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <target dev="tapb7ee8de7-e6"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </interface>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/console.log" append="off"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </serial>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <video>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </video>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </rng>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:   </devices>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]: </domain>
May 26 05:04:51.350533 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:04:51.352518 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Preparing to wait for external event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:04:51.352518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:51.352518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:51.352518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:51.353009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1664079945',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:03:38Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:04:26.705820',shelved_host='np0000001388',shelved_image_id='7ff1e98c-dc9e-43fd-9fed-b66fcde744ed'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:04:51.353009 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:04:51.354018 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:04:51.354018 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:04:51.354229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.354466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:51.354719 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:04:51.356437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.356660 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'faf29fba-064b-59f8-83b3-2ceccb4a1b0c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:51.357409 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.358282 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:51.364664 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.369058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.369261 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb7ee8de7-e6, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:51.369501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb7ee8de7-e6, col_values=(('qos', UUID('deb7c3f1-6360-4620-9e03-b3839385a426')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:51.369648 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb7ee8de7-e6, col_values=(('external_ids', {'iface-id': 'b7ee8de7-e65c-4b0f-b64a-2af100a06510', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:9a:c3', 'vm-uuid': 'fa807765-450a-493a-b193-fe0d0fcfcb72'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:04:51.371427 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.373729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:04:51.374700 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00037918700036243536 future=<Future at 0x7d7ac432c380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:51.374806 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:51.375040 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.562925148999966 future=<Future at 0x7d7aa4229dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:51.375419 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Emitting event <LifecycleEvent: 1779771876.3741896, 477377b6-cc48-467a-a9a6-d7f2c7be8743 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:51.375572 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.562347184999908 future=<Future at 0x7d7aa4229dc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:51.375730 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] VM Stopped (Lifecycle Event)
May 26 05:04:51.384425 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:51.385843 np0000001388 nova-compute[98319]: INFO os_vif [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6')
May 26 05:04:51.546130 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2aee7927-5b49-422b-a865-0e8106a0c7da tempest-VolumesBackupsTest-355836651 tempest-VolumesBackupsTest-355836651-project-member] Lock "0ab1ef45-6ef4-4886-8f22-9d2c4c8af777" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.529s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:51.561558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c2dac2-992a-4262-9403-6f5c7608abfa req-0e5a7619-461b-4f92-8b99-36f5e483ac94 service nova] Releasing lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:51.879808 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-64512372-2e9e-4139-b2b9-6a4227c4a206 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: 477377b6-cc48-467a-a9a6-d7f2c7be8743] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:52.170044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:52.170342 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:52.170743 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:ea:3c:2e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:52.172135 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Using config drive
May 26 05:04:52.180385 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:52.687787 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:52.850415 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Creating config drive at /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.config
May 26 05:04:52.855471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgilgck_9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:52.906559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:52.906800 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:52.907019 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:04:52.907244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No VIF found with MAC fa:16:3e:b8:9a:c3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:04:52.908406 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Using config drive
May 26 05:04:52.913971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgilgck_9" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:53.408536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:53.417971 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'ec2_ids' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:53.449574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:53.529530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:53.677866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:53.684229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:53.788287 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f066177a-bb88-4ea3-a69a-210cebde26b4 req-3279a57b-6382-4483-9487-79710d4f65da service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:53.790473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f066177a-bb88-4ea3-a69a-210cebde26b4 req-3279a57b-6382-4483-9487-79710d4f65da service nova] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:53.790473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f066177a-bb88-4ea3-a69a-210cebde26b4 req-3279a57b-6382-4483-9487-79710d4f65da service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:53.790473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f066177a-bb88-4ea3-a69a-210cebde26b4 req-3279a57b-6382-4483-9487-79710d4f65da service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:53.790473 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f066177a-bb88-4ea3-a69a-210cebde26b4 req-3279a57b-6382-4483-9487-79710d4f65da service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Processing event network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:53.926750 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:53.926985 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'keypairs' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:04:54.432876 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<fa807765-450a-493a-b193-fe0d0fcfcb72> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:04:54.437755 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:54.487715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:54.490609 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771894.489942, a921deec-f5fe-4c81-a5c2-df30f947a826 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:54.492469 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] VM Started (Lifecycle Event)
May 26 05:04:54.498648 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:54.501810 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Instance spawned successfully.
May 26 05:04:54.501810 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:04:54.615258 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Creating config drive at /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config
May 26 05:04:54.628851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ewnoblr {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:04:54.710091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ewnoblr" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:04:55.001049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:55.005362 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:55.016610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.016610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.016610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.016610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.017397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.019723 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:04:55.310446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.352571 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.472060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.515798 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:04:55.515798 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771895.5137537, a921deec-f5fe-4c81-a5c2-df30f947a826 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:55.515798 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] VM Paused (Lifecycle Event)
May 26 05:04:55.528269 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Took 7.12 seconds to spawn the instance on the hypervisor.
May 26 05:04:55.528524 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:55.555487 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5b3ecd03-a02f-4454-9d65-527cbdd52836 req-ff960c96-cab1-4649-89ca-b746ddf576bf service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:55.555750 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b3ecd03-a02f-4454-9d65-527cbdd52836 req-ff960c96-cab1-4649-89ca-b746ddf576bf service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:55.556022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b3ecd03-a02f-4454-9d65-527cbdd52836 req-ff960c96-cab1-4649-89ca-b746ddf576bf service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:55.556264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5b3ecd03-a02f-4454-9d65-527cbdd52836 req-ff960c96-cab1-4649-89ca-b746ddf576bf service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:55.556462 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5b3ecd03-a02f-4454-9d65-527cbdd52836 req-ff960c96-cab1-4649-89ca-b746ddf576bf service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Processing event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:04:55.772254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.847450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.856221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.874164 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:55.923283 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:55.924092 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:55.924450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:55.924673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:55.924804 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] No waiting events found dispatching network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:55.924981 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-c8f99ee3-67a8-4676-948d-323aacd3316b req-3ebf00da-a142-4a23-944e-bc918c51fc31 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received unexpected event network-vif-plugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b for instance with vm_state active and task_state None.
May 26 05:04:56.017167 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:56.023021 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771896.0226588, a921deec-f5fe-4c81-a5c2-df30f947a826 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:56.023218 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] VM Resumed (Lifecycle Event)
May 26 05:04:56.049639 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Took 12.78 seconds to build instance.
May 26 05:04:56.371249 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:56.528791 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:56.532067 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:56.536810 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:04:56.540049 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:04:56.543742 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance spawned successfully.
May 26 05:04:56.554113 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.292s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004893830000582966 future=<Future at 0x7d7aa4229dc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.948606019000181 future=<Future at 0x7d7aec0d6180 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.9484855350001453 future=<Future at 0x7d7aec0d6180 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] Emitting event <LifecycleEvent: 1779771881.9378471, 661946b3-8401-4c5e-a448-d14238a62087 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] VM Stopped (Lifecycle Event)
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771897.0344803, fa807765-450a-493a-b193-fe0d0fcfcb72 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Started (Lifecycle Event)
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4c4c172f-83d4-49f8-84ac-8da06ec3727b tempest-TaggedBootDevicesTest_v242-15632634 tempest-TaggedBootDevicesTest_v242-15632634-project-member] [instance: 661946b3-8401-4c5e-a448-d14238a62087] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing instance network info cache due to event network-changed-dc13fc7e-fb16-41c7-864b-b68f89d55b7e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] Acquiring lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] Acquired lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Refreshing network info cache for port dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f00a535f-e581-4e11-998f-8f8a28268114 req-dc65c4c9-9de4-41ba-a324-f668dfa39481 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received unexpected event network-vif-plugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with vm_state active and task_state None.
May 26 05:04:57.953582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d5a9f2b3-d3c1-424d-8552-d34806ff2b80 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.766s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:04:58.054994 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771898.054472, fa807765-450a-493a-b193-fe0d0fcfcb72 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:58.055292 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Paused (Lifecycle Event)
May 26 05:04:58.209635 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:58.347862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:04:58.561272 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:58.564291 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771898.563767, fa807765-450a-493a-b193-fe0d0fcfcb72 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:58.564291 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Resumed (Lifecycle Event)
May 26 05:04:58.790948 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:04:58.994699 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updated VIF entry in instance network info cache for port dc13fc7e-fb16-41c7-864b-b68f89d55b7e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:04:58.995329 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating instance_info_cache with network_info: [{"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:04:59.070295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:04:59.073235 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:04:59.498574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cdeeeb68-ecd8-4bb5-bff6-6babeea7741c req-eb33261e-7a49-4b4c-bb98-c4f60ca00692 service nova] Releasing lock "refresh_cache-21be2726-991c-4d86-971a-d2033d23977b" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:04:59.780440 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:04:59.781558 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing instance network info cache due to event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:04:59.781558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] Acquiring lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:04:59.781558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] Acquired lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:04:59.781838 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:04:59.889017 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.001416972000242822 future=<Future at 0x7d7aec0d6180 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:59.889164 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:04:59.889702 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779771884.8872862, 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:04:59.889970 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] VM Stopped (Lifecycle Event)
May 26 05:04:59.946797 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Rebuilding instance
May 26 05:04:59.997055 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:04:59.997448 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:00.160680 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:00.291253 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:00.396480 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 0ab1ef45-6ef4-4886-8f22-9d2c4c8af777] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:00.503723 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:00.711107 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:00.852650 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updated VIF entry in instance network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:00.853069 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating instance_info_cache with network_info: [{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:01.207191 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.212953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.238564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.247418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.282540 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.284324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.358492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4a5e5dc-994b-42cb-b913-a1300e01fb33 req-bdd6d852-44f9-4b1b-bdc4-9603574189d0 service nova] Releasing lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:01.372525 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.449718 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:01.453124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:01.453124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:01.453124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:01.453124 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:01.453320 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-ebdb9566-6a6a-42a4-b1e3-06f3e360f814 req-1096f8c4-ab25-450f-b7e4-4aecf6abf10e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received unexpected event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with vm_state active and task_state rebuilding.
May 26 05:05:01.517370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:01.554499 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999688861999857 future=<Future at 0x7d7ac44163c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:01.555596 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998668324999926 future=<Future at 0x7d7ac44163c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:01.556805 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997544355999707 future=<Future at 0x7d7ac44163c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:01.564507 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance destroyed successfully.
May 26 05:05:01.580214 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance destroyed successfully.
May 26 05:05:01.583745 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1324898471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:18Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:04:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:05:01.583745 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:01.585458 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:01.585458 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:05:01.588911 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.588911 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap676f5209-3a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:01.591150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.592219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:01.593481 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.595240 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.595636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5033a06f-4763-4152-8b8b-3c35c3495202) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:01.597630 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.598462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:01.602122 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:01.604990 np0000001388 nova-compute[98319]: INFO os_vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a')
May 26 05:05:01.610165 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:05:01.610987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:01.610987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:01.611550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:01.612442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:05:01.612532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:01.663595 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [74] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [75] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:01.667102 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '74'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '75'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '86')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:05:01.667102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '74')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:01.670767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '75')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:01.671970 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4378c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:05:01.672139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Removing multipathed devices sdg, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:05:01.672606 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flush multipath device 330000000446e21b4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:05:01.761851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:01.811159 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:01.862053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Checking to see if SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:05:01.862349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] SCSI volumes sdg, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:05:01.865170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Checking to see if device paths {'sdg', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:05:01.881592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Device paths {'sdg', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:05:01.883396 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:05:01.900490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:01.942619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 74, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260]
May 26 05:05:01.942619 np0000001388 nova-compute[98319]: Logout of [sid: 74, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260] successful.
May 26 05:05:01.942619 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:01.968599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:01.984419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:02.032608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 75, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260]
May 26 05:05:02.032608 np0000001388 nova-compute[98319]: Logout of [sid: 75, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260] successful.
May 26 05:05:02.032608 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:02.053659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:02.053886 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:02.054314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== disconnect_volume: return (443ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:02.055480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:05:02.055946 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deleting instance files /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1_del
May 26 05:05:02.057413 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deletion of /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1_del complete
May 26 05:05:02.186072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:02.639333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:02.639333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:02.639333 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Attaching volume c2aeb5fc-379a-4e88-b2f3-021a925f445f to /dev/vdb
May 26 05:05:02.693616 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 could not be found.
May 26 05:05:02.695552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:05:02.695552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:02.695552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:02.695552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:02.696287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:05:02.696287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:05:02.699487 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:02.722835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:02.746701 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1', '85'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7', '86')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f0fe0>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== disconnect_volume: return (51ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:02.746701 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:05:02.758361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:02.808221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:05:02.808874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:05:02.819070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:05:02.820962 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d'] 
May 26 05:05:02.821189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:05:02.821370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:05:02.821679 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:02.821999 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating existing volume attachment record: be1fdda1-a8d1-4907-8c12-838f9f907781 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:05:03.199243 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:03.392041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:05:03.393101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:03.393101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:03.393101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:03.395945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:05:03.410589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:03.410810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:03.411269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:03.411694 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:05:03.412768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:03.413116 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:05:03.429799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:05:03.429799 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:03.444626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:05:03.444626 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:03.453451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f] added
May 26 05:05:03.453451 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:05:03.453451 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:03.453451 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:03.453451 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:03.453451 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:03.453451 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:03.453747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:05:03.453916 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0408(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:05:03.454148 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:05:03.459133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f] added
May 26 05:05:03.459133 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:05:03.459133 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:03.459133 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:03.459133 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:03.459133 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:03.459133 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:03.460091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:05:03.460091 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0484(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:05:03.460091 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:05:03.558467 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:03.558467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:03.558467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:03.558467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:03.558628 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:03.560290 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-41b88cff-8f72-4dd6-a06d-14dc25f75afa req-b551e998-b0cf-47ab-92de-d1b73dfc48b9 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received unexpected event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with vm_state active and task_state rebuilding.
May 26 05:05:03.991011 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Preparing to wait for external event volume-reimaged-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:03.991508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:03.991508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:03.991508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:04.455140 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:05:04.461339 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:04.473876 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:04.473876 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:04.489671 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:04.489671 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.499473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.513967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.522679 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.536937 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.539480 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:04.593680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.50.100,3260]
May 26 05:05:04.593680 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.50.100,3260] successful.
May 26 05:05:04.593680 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.602599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.40.100,3260]
May 26 05:05:04.602599 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.40.100,3260] successful.
May 26 05:05:04.602599 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.611392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.624392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.636144 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.636543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:04.637428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.224s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:04.637428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:04.637949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('11', '-', '-', 0) found on session 87 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:04.638101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [85] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fe6c53e4-5dca-4cff-997a-311b0d3d85e1 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [86] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7a6ba535-58a9-47e2-a7e5-64cf25d32fa7 (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:04.658622 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.246s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:04.658622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:04.661009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('12', '-', '-', 0) found on session 88 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:04.661009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:04.662114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 87 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:04.665769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:04.692246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 88 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:04.692246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:05.412213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:05:05.584955 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:06.440182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 330000000d979aac1 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:05:06.440182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:06.440182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (3046ms) {'type': 'block', 'scsi_wwn': '330000000d979aac1', 'path': '/dev/dm-4', 'multipath_id': '330000000d979aac1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:06.440182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d979aac1', 'path': '/dev/dm-4', 'multipath_id': '330000000d979aac1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:05:06.450335 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:06.597595 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:06.960724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Attempting to attach volume c2aeb5fc-379a-4e88-b2f3-021a925f445f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:05:06.961413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:06.961413 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:05:07.187729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:08.718553 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:08.718553 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:08.719171 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:08.719171 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:22:1b:83, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:10.196962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:10.198487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:10.330025 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-befa9768-e1d6-467d-86a8-2103036fcb5a tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.692s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:10.644666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:10.644666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:10.704369 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:11.147171 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:11.599339 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:11.702227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:11.702482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:11.706753 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:11.706753 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Claim successful on node np0000001388
May 26 05:05:11.711460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:12.188716 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:12.877120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:12.877513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:12.877513 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Attaching volume c2aeb5fc-379a-4e88-b2f3-021a925f445f to /dev/vdb
May 26 05:05:12.936372 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:12.955292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:05:12.994093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:13.041899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:05:13.041899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:05:13.050625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:05:13.052146 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d'] 
May 26 05:05:13.052389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:05:13.052579 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:05:13.052990 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:13.053390 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating existing volume attachment record: c70ee4e3-c51f-41bf-9694-47085d5c4047 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:05:13.214478 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:13.214684 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:13.637869 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:05:13.638121 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:13.638311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:13.719337 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:13.739708 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.101s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:13.740007 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:05:13.762017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:13.762017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:13.762486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:13.762486 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:05:13.770268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.008s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:13.770268 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:13.787263 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:13.787263 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:13.794929 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:13.794929 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:13.810027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:13.822711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.831095 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.831464 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:13.831861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.070s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:13.832149 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:13.833679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('11', '0', '0', 0) found on session 87 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:13.833962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 11 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:13.848558 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 87 and hctl ('11', '0', '0', 0) yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:13.848728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.855767 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:13.856543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.088s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:13.856543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:13.857408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('12', '0', '0', 0) found on session 88 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:13.857600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 12 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:13.872420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 88 and hctl ('12', '0', '0', 0) yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:13.872953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:14.141410 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 req-ce4e4aa5-d8f9-4f02-9340-36d812e57e6f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event volume-reimaged-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:14.142025 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 req-ce4e4aa5-d8f9-4f02-9340-36d812e57e6f service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:14.142025 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 req-ce4e4aa5-d8f9-4f02-9340-36d812e57e6f service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:14.142025 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 req-ce4e4aa5-d8f9-4f02-9340-36d812e57e6f service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:14.142465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 req-ce4e4aa5-d8f9-4f02-9340-36d812e57e6f service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Processing event volume-reimaged-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:05:14.143764 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance event wait completed in 9 seconds for volume-reimaged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:14.229800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.527s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:14.230434 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:14.648458 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Booting with volume 27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 at /dev/vda
May 26 05:05:14.700704 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:14.716613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:05:14.741607 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:14.741810 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:14.742149 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:14.742435 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:14.746091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:14.777156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:05:14.804266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:05:14.804504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:05:14.815508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:05:14.816331 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:feb8:9ac3', 'fe80::2c42:7eff:feb2:c76d'] 
May 26 05:05:14.816502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:05:14.816616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:05:14.816864 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:14.817124 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating existing volume attachment record: 46a4647e-89c7-4759-8cc1-30f81dc01dc1 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:05:14.887622 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bea66e2b64da4ac5ac8a73b1a96729b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a4d9d2fc50e407ba6bebe55361fcd9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:15.246765 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:15.258000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:15.595277 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Successfully created port: 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:15.751714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:15.804736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 330000000d979aac1 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:05:15.805115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.066s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:15.805325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (2166ms) {'type': 'block', 'scsi_wwn': '330000000d979aac1', 'path': '/dev/dm-4', 'multipath_id': '330000000d979aac1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:15.805508 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000d979aac1', 'path': '/dev/dm-4', 'multipath_id': '330000000d979aac1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:05:15.810581 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:16.242232 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Successfully updated port: 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:16.313950 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Attempting to attach volume c2aeb5fc-379a-4e88-b2f3-021a925f445f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:05:16.316538 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:16.316538 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:05:16.319625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received event network-changed-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:16.320495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Refreshing instance network info cache due to event network-changed-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:16.320495 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] Acquiring lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:16.322512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] Acquired lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:16.322793 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Refreshing network info cache for port 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:16.554646 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004567870000755647 future=<Future at 0x7d7ac44163c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:16.556471 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Emitting event <LifecycleEvent: 1779771901.5540547, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:16.556471 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Stopped (Lifecycle Event)
May 26 05:05:16.556471 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:16.606505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:16.745443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:16.763598 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:16.764739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:16.765025 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Creating image(s)
May 26 05:05:16.765693 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:16.765902 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:16.766415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:16.767556 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:16.771710 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:16.773787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:16.829845 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:16.884901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:16.886354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:16.886354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:16.886354 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:16.891825 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:16.892421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:16.924302 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:16.961880 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:16.962306 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating image(s)
May 26 05:05:16.962766 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:05:16.963016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Ensure instance console log exists: /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:16.963352 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:16.964007 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:16.964257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:16.964920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start _get_guest_xml network_info=[{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-26T04:55:38Z,direct_url=<?>,disk_format='qcow2',id=7353cfc8-6605-4735-b2e1-84717957e228,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-26T04:55:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '46a4647e-89c7-4759-8cc1-30f81dc01dc1', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '569c7477-611f-4fc2-bbc9-b6ce2a2c92d1', 'attached_at': '', 'detached_at': '', 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'serial': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:16.971676 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
May 26 05:05:16.973036 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='7353cfc8-6605-4735-b2e1-84717957e228', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-1324898471', uuid='569c7477-611f-4fc2-bbc9-b6ce2a2c92d1'), owner=OwnerMeta(userid='e0939d86f1084b2c982cd2582f27ad96', username='tempest-ServerActionsV293TestJSON-1167911011-project-member', projectid='9b6c6daea7064df7973a1e2e20e2582f', projectname='tempest-ServerActionsV293TestJSON-1167911011'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771916.9725604) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:16.975724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:16.975724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:16.976463 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:16.976651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:16.977597 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:16.977934 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-05-26T04:55:38Z,direct_url=<?>,disk_format='qcow2',id=7353cfc8-6605-4735-b2e1-84717957e228,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21233664,status='active',tags=<?>,updated_at=2026-05-26T04:55:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:16.978071 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:16.978165 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:16.978335 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:16.978417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:16.978940 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:16.978940 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:16.978940 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:16.979025 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:16.979074 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:16.979213 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:16.980296 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lazy-loading 'vcpu_model' on Instance uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:17.027717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:17.029570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:17.062411 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9a4d3e8b-2a49-49ed-9afe-96c8b7bbe022 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:17.096684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk 1073741824" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:17.097572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:17.099899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:17.191814 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:17.194928 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:17.220225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.121s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:17.220887 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:17.221159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:17.310857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:17.311620 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Cannot resize image /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:17.312095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:17.312340 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Ensure instance console log exists: /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:17.312650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:17.312913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:17.313070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:17.503959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:05:17.504490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:17.504734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:17.695082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-487495b7-e0df-44ad-b15a-8c7c130dd9be req-fc8fb53c-43b7-4286-ad5a-ae75159766a5 service nova] Releasing lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:17.695759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquired lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:17.696289 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:18.003371 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:18.003515 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:18.003642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:18.003760 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:ea:3c:2e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:18.159545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.655s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:18.159784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:05:18.172517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:18.172994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:18.173229 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:05:18.174621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:18.175435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:18.175614 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:05:18.190794 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:05:18.190794 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:18.197454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:05:18.197454 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0] added
May 26 05:05:18.207930 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:18.207930 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:05:18.207930 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:05:18.215994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0] added
May 26 05:05:18.215994 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:05:18.215994 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:18.215994 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:18.215994 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:05:18.215994 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:05:18.215994 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:18.216573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:05:18.216573 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0407(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:05:18.216714 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:05:18.297510 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:18.488895 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:18.618226 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:18.618595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 26 05:05:18.648696 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating instance_info_cache with network_info: [{"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:18.800460 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.121294 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:19.153436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Releasing lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:19.153436 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance network_info: |[{"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:05:19.158047 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Start _get_guest_xml network_info=[{"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:19.160949 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:19.162296 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestServerVolumeAttachmentScenario-server-765989012', uuid='a2b00aa6-8223-4ad4-8bb6-3776a26ec450'), owner=OwnerMeta(userid='bea66e2b64da4ac5ac8a73b1a96729b3', username='tempest-TestServerVolumeAttachmentScenario-952799259-project-member', projectid='9a4d9d2fc50e407ba6bebe55361fcd9a', projectname='tempest-TestServerVolumeAttachmentScenario-952799259'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771919.1618679) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:19.163763 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:19.164319 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:19.165676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:19.166007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:19.167336 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:19.167807 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:19.168006 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:19.168182 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:19.168564 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:19.168564 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:19.168715 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:19.168853 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:19.169017 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:19.169177 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:19.169352 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:19.169478 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:19.186902 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-765989012',display_name='tempest-TestServerVolumeAttachmentScenario-server-765989012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachmentscenario-server-765989012',id=34,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAMq5mBl39p3skYN03GmF869tjBmVUzoWg+Dkayt6IIoBVKptng0Wr+TtSrh8IGzi1oXbJo92rls+gYvBbXD8CzmdSw66xottZYKCzysulA4J2gJGFibkd7PErr4FAdg==',key_name='tempest-keypair-100102815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4d9d2fc50e407ba6bebe55361fcd9a',ramdisk_id='',reservation_id='r-hzgnwlm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-952799259',owner_user_name='tempest-TestServerVolumeAttachmentScenario-952799259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bea66e2b64da4ac5ac8a73b1a96729b3',uuid=a2b00aa6-8223-4ad4-8bb6-3776a26ec450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:19.187154 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converting VIF {"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:19.187938 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:19.189298 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'pci_devices' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:19.208220 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:05:19.217050 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:19.223822 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:19.223822 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:05:19.233522 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:05:19.233522 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.242554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.249459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.262530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.263570 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.273235 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:19.307992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260]
May 26 05:05:19.307992 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260] successful.
May 26 05:05:19.307992 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.317879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260]
May 26 05:05:19.317879 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260] successful.
May 26 05:05:19.317879 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.328230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.335246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.343056 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.343692 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:19.343692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:19.344491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:19.345045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] HCTL ('10', '-', '-', 0) found on session 92 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:19.345219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.357992 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [91] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-21cd237c-eba2-4fca-9fd4-87adf173b2d4 (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:19.358301 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:19.358600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:19.358747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:05:19.362100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] HCTL ('13', '-', '-', 0) found on session 93 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:05:19.362100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:05:19.362533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:19.386274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 93 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:19.386274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:19.577743 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bd656793-6cdd-4169-8131-69d30de6465d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.700s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:19.692369 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <uuid>a2b00aa6-8223-4ad4-8bb6-3776a26ec450</uuid>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <name>instance-00000022</name>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-765989012</nova:name>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:19</nova:creationTime>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:user uuid="bea66e2b64da4ac5ac8a73b1a96729b3">tempest-TestServerVolumeAttachmentScenario-952799259-project-member</nova:user>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:project uuid="9a4d9d2fc50e407ba6bebe55361fcd9a">tempest-TestServerVolumeAttachmentScenario-952799259</nova:project>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         <nova:port uuid="60c7d8b0-5ee7-4760-9189-072a3cc3f6b9">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="serial">a2b00aa6-8223-4ad4-8bb6-3776a26ec450</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="uuid">a2b00aa6-8223-4ad4-8bb6-3776a26ec450</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.config"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:48:6a:f6"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <target dev="tap60c7d8b0-5e"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/console.log" append="off"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:19.692369 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Preparing to wait for external event network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-765989012',display_name='tempest-TestServerVolumeAttachmentScenario-server-765989012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachmentscenario-server-765989012',id=34,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAMq5mBl39p3skYN03GmF869tjBmVUzoWg+Dkayt6IIoBVKptng0Wr+TtSrh8IGzi1oXbJo92rls+gYvBbXD8CzmdSw66xottZYKCzysulA4J2gJGFibkd7PErr4FAdg==',key_name='tempest-keypair-100102815',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9a4d9d2fc50e407ba6bebe55361fcd9a',ramdisk_id='',reservation_id='r-hzgnwlm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-952799259',owner_user_name='tempest-TestServerVolumeAttachmentScenario-952799259-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bea66e2b64da4ac5ac8a73b1a96729b3',uuid=a2b00aa6-8223-4ad4-8bb6-3776a26ec450,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converting VIF {"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:19.694982 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:19.695354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.695544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:19.695767 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:19.696486 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.696636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e708f5a4-ea12-5160-8ab8-bc32f70f3914', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:19.699748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.700684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:19.701093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.703787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.703975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c7d8b0-5e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:19.704294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60c7d8b0-5e, col_values=(('qos', UUID('e2165212-ffe0-465c-bdd4-841a18100eb4')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:19.704484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60c7d8b0-5e, col_values=(('external_ids', {'iface-id': '60c7d8b0-5ee7-4760-9189-072a3cc3f6b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:6a:f6', 'vm-uuid': 'a2b00aa6-8223-4ad4-8bb6-3776a26ec450'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:19.705369 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.706984 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:19.711688 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:19.713097 np0000001388 nova-compute[98319]: INFO os_vif [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e')
May 26 05:05:20.144335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:20.144335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:20.363335 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Searching for a device in session 92 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:05:20.363568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:05:20.648408 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Detaching volume c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:20.697583 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Attempting to driver detach volume c2aeb5fc-379a-4e88-b2f3-021a925f445f from mountpoint /dev/vdb
May 26 05:05:20.704372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:20.705992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:20.705992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Attempting to detach device vdb from instance 21be2726-991c-4d86-971a-d2033d23977b from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:05:20.705992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:20.705992 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:20.719548 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 21be2726-991c-4d86-971a-d2033d23977b from the persistent domain config.
May 26 05:05:20.719548 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] (1/8): Attempting to detach device vdb with device alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f from instance 21be2726-991c-4d86-971a-d2033d23977b from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:05:20.719548 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:20.719548 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:21.202388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Found WWN 330000000446e21b4 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:05:21.202712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.043s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:21.202958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== connect_volume: return (3698ms) {'type': 'block', 'scsi_wwn': '330000000446e21b4', 'path': '/dev/dm-1', 'multipath_id': '330000000446e21b4'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:21.203099 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000446e21b4', 'path': '/dev/dm-1', 'multipath_id': '330000000446e21b4'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:05:21.231778 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:21.232053 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:21.232261 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No VIF found with MAC fa:16:3e:48:6a:f6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:21.232919 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Using config drive
May 26 05:05:21.376617 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771921.375597, 21be2726-991c-4d86-971a-d2033d23977b => ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:05:21.377488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f for instance 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:05:21.381280 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 21be2726-991c-4d86-971a-d2033d23977b from the live domain config.
May 26 05:05:21.708238 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1324898471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:18Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:21.708885 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:21.708990 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:21.711222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <uuid>569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</uuid>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <name>instance-0000001d</name>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1324898471</nova:name>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:16</nova:creationTime>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:image uuid="7353cfc8-6605-4735-b2e1-84717957e228">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:user uuid="e0939d86f1084b2c982cd2582f27ad96">tempest-ServerActionsV293TestJSON-1167911011-project-member</nova:user>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:project uuid="9b6c6daea7064df7973a1e2e20e2582f">tempest-ServerActionsV293TestJSON-1167911011</nova:project>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid="7353cfc8-6605-4735-b2e1-84717957e228"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         <nova:port uuid="676f5209-3ac4-47fa-99ef-82e1fbd9de7f">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="serial">569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="uuid">569c7477-611f-4fc2-bbc9-b6ce2a2c92d1</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <alias name="ua-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <serial>27dd5aab-e57a-48be-8f31-bc0bf7b55ad0</serial>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:08:35:60"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <target dev="tap676f5209-3a"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/console.log" append="off"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:21.711222 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:21.711222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1324898471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:18Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:21.711222 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:21.714044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.717536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '31b2c4ad-e70f-571f-9c8a-2a974b992442', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:21.717536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.717536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:21.721145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.723951 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.724309 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap676f5209-3a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:21.724716 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap676f5209-3a, col_values=(('qos', UUID('ff15137f-7d1e-4d2e-87bd-76cd7ca84a9e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:21.724948 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap676f5209-3a, col_values=(('external_ids', {'iface-id': '676f5209-3ac4-47fa-99ef-82e1fbd9de7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:35:60', 'vm-uuid': '569c7477-611f-4fc2-bbc9-b6ce2a2c92d1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:21.725735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.727307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:21.740829 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:21.744371 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:21.745620 np0000001388 nova-compute[98319]: INFO os_vif [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a')
May 26 05:05:21.896654 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Creating config drive at /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.config
May 26 05:05:21.900879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7kqu0ss {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:21.925986 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Detected multiple connections on this host for volume: c2aeb5fc-379a-4e88-b2f3-021a925f445f, skipping target disconnect.
May 26 05:05:21.952942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmps7kqu0ss" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:22.191611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.394769 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.432023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.492631 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:22.541691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.799209 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.841309 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.848417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.877930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:22.884158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:23.120994 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:23.122333 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:23.122762 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.38 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:23.272705 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:23.272882 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:23.272882 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] No VIF found with MAC fa:16:3e:08:35:60, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:23.273638 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Using config drive
May 26 05:05:23.383144 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771923.3820086, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:23.383144 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] VM Started (Lifecycle Event)
May 26 05:05:23.501675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f2053c8-8f35-4906-be93-cbbc8fb3c444 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.357s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:23.502557 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:23.503541 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:23.593338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:23.593551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:23.617746 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:23.619493 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:23.776085 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lazy-loading 'ec2_ids' on Instance uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:23.885368 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:23.886998 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771923.8867614, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:23.887119 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] VM Paused (Lifecycle Event)
May 26 05:05:24.095813 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Detaching volume c2aeb5fc-379a-4e88-b2f3-021a925f445f
May 26 05:05:24.145599 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Attempting to driver detach volume c2aeb5fc-379a-4e88-b2f3-021a925f445f from mountpoint /dev/vdb
May 26 05:05:24.149302 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:24.152145 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:24.152287 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Attempting to detach device vdb from instance a921deec-f5fe-4c81-a5c2-df30f947a826 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:05:24.152544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:24.152544 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:24.160575 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance a921deec-f5fe-4c81-a5c2-df30f947a826 from the persistent domain config.
May 26 05:05:24.160741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] (1/8): Attempting to detach device vdb with device alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f from instance a921deec-f5fe-4c81-a5c2-df30f947a826 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:05:24.161055 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <alias name="ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f"/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <serial>c2aeb5fc-379a-4e88-b2f3-021a925f445f</serial>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:24.161055 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:24.280127 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Object Instance<569c7477-611f-4fc2-bbc9-b6ce2a2c92d1> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:05:24.280416 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lazy-loading 'keypairs' on Instance uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:24.392321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:24.406089 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:24.617677 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:24.618061 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:24.744968 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e3e118f9-1221-4aa4-ac10-d295edc84f06 req-0f5e3eb1-8486-48c0-b527-56c26d7d6e08 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received event network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:24.745284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3e118f9-1221-4aa4-ac10-d295edc84f06 req-0f5e3eb1-8486-48c0-b527-56c26d7d6e08 service nova] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:24.751024 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3e118f9-1221-4aa4-ac10-d295edc84f06 req-0f5e3eb1-8486-48c0-b527-56c26d7d6e08 service nova] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:24.751189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e3e118f9-1221-4aa4-ac10-d295edc84f06 req-0f5e3eb1-8486-48c0-b527-56c26d7d6e08 service nova] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:24.751354 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e3e118f9-1221-4aa4-ac10-d295edc84f06 req-0f5e3eb1-8486-48c0-b527-56c26d7d6e08 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Processing event network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:05:24.753183 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:24.759225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:05:24.759965 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance spawned successfully.
May 26 05:05:24.760311 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:05:24.766606 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:24.783189 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Object Instance<569c7477-611f-4fc2-bbc9-b6ce2a2c92d1> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:05:24.786255 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError
May 26 05:05:24.913086 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:24.913515 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771924.913225, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:24.913685 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] VM Resumed (Lifecycle Event)
May 26 05:05:24.972412 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Creating config drive at /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config
May 26 05:05:24.977270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd9vpztmd {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:25.043212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpd9vpztmd" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:25.273731 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.274393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.274393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.274697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.275033 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.275979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:25.419497 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:25.427217 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:25.592846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:25.618305 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:25.618803 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:25.627136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:25.628875 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:25.752270 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:25.786562 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Took 9.02 seconds to spawn the instance on the hypervisor.
May 26 05:05:25.787044 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:25.880327 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:25.880438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:25.881756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:25.881756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:25.881756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:25.881756 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a69a32b4-84bf-4bc3-b81d-d053992097f7 req-56dd0fe7-297f-47b5-b899-35ed9145c5ad service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received unexpected event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with vm_state active and task_state rebuild_spawning.
May 26 05:05:25.929938 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:26.073149 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:26.084033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:26.084033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:26.106324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:26.305115 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Took 14.65 seconds to build instance.
May 26 05:05:26.501416 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:26.501687 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:26.618670 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:26.618838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:05:26.619065 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:26.619212 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 26 05:05:26.713645 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:26.713972 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:05:26.720222 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771926.7155006, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:26.720222 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Resumed (Lifecycle Event)
May 26 05:05:26.725640 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance spawned successfully.
May 26 05:05:26.725640 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:05:26.728478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:26.807703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:26.838328 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received event network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:26.838589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:26.839400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:26.839400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:26.839517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] No waiting events found dispatching network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:26.839726 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-fd64abd7-1aaf-4edd-aa41-61f81329a9cc req-720c92da-92ba-4b5c-b398-ac62db9e5b3a service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received unexpected event network-vif-plugged-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 for instance with vm_state active and task_state None.
May 26 05:05:26.878687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:26.878942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:27.126113 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 26 05:05:27.126567 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:27.157691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received event network-changed-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:27.160388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Refreshing instance network info cache due to event network-changed-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:27.160388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] Acquiring lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:27.160388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] Acquired lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:27.160388 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Refreshing network info cache for port 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:27.194334 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:27.224977 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:27.227732 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:27.240500 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.240500 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.240886 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.242917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.242917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.242917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:27.383580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:27.392519 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f for instance a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:05:27.661278 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:27.732906 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
May 26 05:05:27.733122 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771927.7328808, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:27.733279 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Started (Lifecycle Event)
May 26 05:05:27.748050 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:27.958828 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:27.961892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:27.962517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:27.962887 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:27.963152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:27.963368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:27.963599 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:27.964027 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8c2bc970-7782-4a48-be3b-9da05b9d13e3 req-9c7d1e12-052d-4d58-ac07-122005a5077e service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received unexpected event network-vif-plugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with vm_state active and task_state None.
May 26 05:05:27.966468 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:27.966573 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Claim successful on node np0000001388
May 26 05:05:28.069011 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:28.125234 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:28.236015 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:28.238923 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:28.255376 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updated VIF entry in instance network info cache for port 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:28.255820 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating instance_info_cache with network_info: [{"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:28.262713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:28.630253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:28.743757 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771928.743358, a921deec-f5fe-4c81-a5c2-df30f947a826 => ua-c2aeb5fc-379a-4e88-b2f3-021a925f445f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:05:28.748377 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance a921deec-f5fe-4c81-a5c2-df30f947a826 from the live domain config.
May 26 05:05:28.760954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-46a175b8-0252-483e-ad25-1a1e0099bbc3 req-72119324-a316-42a8-8f10-2414700b9bf2 service nova] Releasing lock "refresh_cache-a2b00aa6-8223-4ad4-8bb6-3776a26ec450" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:28.787387 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:05:28.787812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:28.787998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:28.788447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:28.788855 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'c2aeb5fc-379a-4e88-b2f3-021a925f445f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:05:28.789051 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b (non-flash)
May 26 05:05:28.819563 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [87] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [88] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b (non-flash)
May 26 05:05:28.820114 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '84'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', '87'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', '88'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b', '94')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:05:28.820114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', '88')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:28.821211 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f', '87')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:28.822240 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46dbce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:05:28.822636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:05:28.822815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flush multipath device 330000000d979aac1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:05:28.853501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:28.910994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:28.955955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:05:28.956186 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:05:28.957888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:05:28.978725 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:05:28.978983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:05:28.998156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.043947 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 88, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.40.100,3260]
May 26 05:05:29.043947 np0000001388 nova-compute[98319]: Logout of [sid: 88, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.40.100,3260] successful.
May 26 05:05:29.043947 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.067271 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.081743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.124593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 87, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.50.100,3260]
May 26 05:05:29.124593 np0000001388 nova-compute[98319]: Logout of [sid: 87, target: iqn.2023-03.storpool.com:os--volume-c2aeb5fc-379a-4e88-b2f3-021a925f445f, portal: 192.168.50.100,3260] successful.
May 26 05:05:29.124593 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.143569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:29.143843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:29.143981 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== disconnect_volume: return (356ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:29.144114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:05:29.477917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:29.478368 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:29.723944 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:29.980654 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:30.488227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.526s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:30.490557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 2.226s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:30.490948 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:30.493550 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98319) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}}
May 26 05:05:30.733504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c9a7c939-32c1-4fda-b585-bb7a38465942 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:31.006993 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:31.006993 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:31.006993 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:31.006993 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:31.113238 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e648294e50d4dabbb49fc071dc1a56f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '616737caae164e1bb3b0886d8eccdc40', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:31.512941 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:31.519434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-97817236-dbe5-463e-8e12-d2fe6b07d5b4 tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 1.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:31.526537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 2.894s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:31.526537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:31.526537 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:05:31.721785 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Successfully created port: 42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:31.730165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:32.024574 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:32.194895 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:32.248231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:32.249255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:32.386408 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Successfully updated port: 42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:32.448044 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-changed-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:32.448709 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Refreshing instance network info cache due to event network-changed-42b1a1a6-b799-4fa4-b382-2af64f6f084c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:32.448997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] Acquiring lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:32.449147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] Acquired lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:32.450414 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Refreshing network info cache for port 42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:32.578644 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:05:32.582263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:32.739821 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:32.740421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:32.767249 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:32.857805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:32.862017 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:05:32.864055 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:32.890340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:32.953755 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:32.959210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:32.959692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.035743 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:33.039124 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:33.041544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:33.041972 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Creating image(s)
May 26 05:05:33.042608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:33.042882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:33.043711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:33.045605 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:33.048235 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:33.049342 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.065903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.076232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.149125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.150042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:33.150669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:33.151480 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:33.156291 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:33.156291 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.193281 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.195051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.260103 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.264569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.313754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.329577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.359038 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:33.371069 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk 1073741824" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.374221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:33.375376 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.431016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:33.431322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:33.435405 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:33.435555 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Claim successful on node np0000001388
May 26 05:05:33.442740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.443279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.465518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.466387 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:33.466782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.548629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.549116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:05:33.552229 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:33.553641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:33.554303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.566334 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Cannot resize image /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:33.567337 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:33.567842 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Ensure instance console log exists: /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:33.568273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:33.568644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:33.568906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:33.595717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.042s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:33.596125 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12418MB free_disk=73.06524276733398GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:05:33.596255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:33.871551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-13dacb3f-0f58-4f85-863f-c5e871ea3d20 req-334165b4-9832-48ad-824c-2e89e547ef67 service nova] Releasing lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:33.871819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquired lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:33.872005 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:34.535078 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:34.752134 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:34.945694 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Updating instance_info_cache with network_info: [{"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:35.031451 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:35.032339 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:35.035827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:35.035827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:35.448635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Releasing lock "refresh_cache-aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:35.448960 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance network_info: |[{"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:05:35.450991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Start _get_guest_xml network_info=[{"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:35.453784 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:35.455315 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesActionsTest-instance-545887147', uuid='aac0d9b3-054d-4fc0-91f8-fce1d835a7ea'), owner=OwnerMeta(userid='5e648294e50d4dabbb49fc071dc1a56f', username='tempest-VolumesActionsTest-419857946-project-member', projectid='616737caae164e1bb3b0886d8eccdc40', projectname='tempest-VolumesActionsTest-419857946'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771935.454926) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:35.456552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:35.456983 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:35.457704 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:35.457927 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:35.458857 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:35.459138 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:35.459289 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:35.459379 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:35.459506 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:35.459587 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:35.459683 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:35.459844 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:35.459938 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:35.460034 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:35.460125 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:35.460249 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:35.475209 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545887147',display_name='tempest-VolumesActionsTest-instance-545887147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-545887147',id=35,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='616737caae164e1bb3b0886d8eccdc40',ramdisk_id='',reservation_id='r-yboodc5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-419857946',owner_user_name='tempest-VolumesActionsTest-419857946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:32Z,user_data=None,user_id='5e648294e50d4dabbb49fc071dc1a56f',uuid=aac0d9b3-054d-4fc0-91f8-fce1d835a7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:35.475448 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converting VIF {"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:35.476183 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:35.476960 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lazy-loading 'pci_devices' on Instance uuid aac0d9b3-054d-4fc0-91f8-fce1d835a7ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:35.537232 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:35.545700 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Detaching volume d3853de5-4e14-4a6f-927b-43d6c6b3f160
May 26 05:05:35.594311 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Attempting to driver detach volume d3853de5-4e14-4a6f-927b-43d6c6b3f160 from mountpoint /dev/vdc
May 26 05:05:35.599598 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Found disk vdc by alias ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:35.603247 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Found disk vdc by alias ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:05:35.603413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Attempting to detach device vdc from instance fa807765-450a-493a-b193-fe0d0fcfcb72 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:05:35.603715 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <alias name="ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160"/>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <serial>d3853de5-4e14-4a6f-927b-43d6c6b3f160</serial>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:35.603715 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:35.616414 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully detached device vdc from instance fa807765-450a-493a-b193-fe0d0fcfcb72 from the persistent domain config.
May 26 05:05:35.616592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] (1/8): Attempting to detach device vdc with device alias ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160 from instance fa807765-450a-493a-b193-fe0d0fcfcb72 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:05:35.616900 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <alias name="ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160"/>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <serial>d3853de5-4e14-4a6f-927b-43d6c6b3f160</serial>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]: </disk>
May 26 05:05:35.616900 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:05:35.980627 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <uuid>aac0d9b3-054d-4fc0-91f8-fce1d835a7ea</uuid>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <name>instance-00000023</name>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesActionsTest-instance-545887147</nova:name>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:35</nova:creationTime>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:user uuid="5e648294e50d4dabbb49fc071dc1a56f">tempest-VolumesActionsTest-419857946-project-member</nova:user>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:project uuid="616737caae164e1bb3b0886d8eccdc40">tempest-VolumesActionsTest-419857946</nova:project>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         <nova:port uuid="42b1a1a6-b799-4fa4-b382-2af64f6f084c">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="serial">aac0d9b3-054d-4fc0-91f8-fce1d835a7ea</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="uuid">aac0d9b3-054d-4fc0-91f8-fce1d835a7ea</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.config"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:41:1c:0e"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <target dev="tap42b1a1a6-b7"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/console.log" append="off"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:35.980627 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Preparing to wait for external event network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545887147',display_name='tempest-VolumesActionsTest-instance-545887147',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-545887147',id=35,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='616737caae164e1bb3b0886d8eccdc40',ramdisk_id='',reservation_id='r-yboodc5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-419857946',owner_user_name='tempest-VolumesActionsTest-419857946-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:32Z,user_data=None,user_id='5e648294e50d4dabbb49fc071dc1a56f',uuid=aac0d9b3-054d-4fc0-91f8-fce1d835a7ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converting VIF {"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:35.983178 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:35.983517 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:35.985269 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.985269 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:35.985269 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:35.985756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.985973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dcfcbcc3-f359-5d58-810a-1e8259028c91', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:35.987261 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.988323 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:35.990178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.993032 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.993421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap42b1a1a6-b7, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:35.993999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap42b1a1a6-b7, col_values=(('qos', UUID('72cf368b-4f51-48c2-ad7f-76ebbe8f59d6')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:35.994239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap42b1a1a6-b7, col_values=(('external_ids', {'iface-id': '42b1a1a6-b799-4fa4-b382-2af64f6f084c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:1c:0e', 'vm-uuid': 'aac0d9b3-054d-4fc0-91f8-fce1d835a7ea'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:35.996666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:35.999021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:36.003706 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:36.004804 np0000001388 nova-compute[98319]: INFO os_vif [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7')
May 26 05:05:36.050245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.619s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:36.050878 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 2.454s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:36.051528 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:36.291616 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:36.291833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:36.293182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160 for instance fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:05:36.293953 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771936.2932508, fa807765-450a-493a-b193-fe0d0fcfcb72 => ua-d3853de5-4e14-4a6f-927b-43d6c6b3f160> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:05:36.296968 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully detached device vdc from instance fa807765-450a-493a-b193-fe0d0fcfcb72 from the live domain config.
May 26 05:05:36.298084 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:05:36.298508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:05:36.298679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:05:36.300010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:05:36.301253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd3853de5-4e14-4a6f-927b-43d6c6b3f160', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:05:36.301253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b (non-flash)
May 26 05:05:36.332784 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [83] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [84] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160 (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]: tcp: [94] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b (non-flash)
May 26 05:05:36.333064 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:05:36.333374 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '83'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '84'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '93'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0909c90d-76f8-4f19-b8ea-38bb8f4d850b', '94')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:05:36.333374 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '83')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:36.334773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160', '84')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:05:36.335438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa42c60c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:05:36.335638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:05:36.335874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flush multipath device 330000000c643fdbd {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:05:36.379992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:36.426601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:05:36.482074 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:05:36.482262 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:05:36.484215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:05:36.498002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:05:36.498321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:05:36.512320 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.543225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 83, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.40.100,3260]
May 26 05:05:36.543225 np0000001388 nova-compute[98319]: Logout of [sid: 83, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.40.100,3260] successful.
May 26 05:05:36.543225 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.565086 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:36.566269 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:36.566691 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:36.567032 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:36.569896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.583241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.624579 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 84, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.50.100,3260]
May 26 05:05:36.624579 np0000001388 nova-compute[98319]: Logout of [sid: 84, target: iqn.2023-03.storpool.com:os--volume-d3853de5-4e14-4a6f-927b-43d6c6b3f160, portal: 192.168.50.100,3260] successful.
May 26 05:05:36.624579 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.645245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:05:36.645245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:05:36.645245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] <== disconnect_volume: return (345ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:05:36.645245 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:05:36.654064 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:36.794604 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:37.070506 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:37.153321 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153321 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153321 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153496 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fa807765-450a-493a-b193-fe0d0fcfcb72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153496 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a921deec-f5fe-4c81-a5c2-df30f947a826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153642 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153758 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance aac0d9b3-054d-4fc0-91f8-fce1d835a7ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.153910 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:05:37.207278 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:37.209576 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'flavor' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:37.275058 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Successfully created port: f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:37.363511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:37.542403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:37.542403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:37.542403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] No VIF found with MAC fa:16:3e:41:1c:0e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:37.542403 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Using config drive
May 26 05:05:37.578379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:37.656880 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e44fef6b-6d4c-49b1-977e-3d190c009d28 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 05:05:37.657069 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:05:37.657650 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:05:33 up 37 min,  2 users,  load average: 8.79, 7.60, 4.26\n', 'num_instances': '8', 'num_vm_active': '6', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '4', 'io_workload': '2', 'num_proj_9a4d9d2fc50e407ba6bebe55361fcd9a': '1', 'num_vm_building': '2', 'num_task_spawning': '1', 'num_proj_616737caae164e1bb3b0886d8eccdc40': '1', 'num_proj_b6925a7d36eb4b919388468635037918': '1', 'num_proj_9b6c6daea7064df7973a1e2e20e2582f': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:05:37.963747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:38.056224 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:38.122051 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Successfully updated port: f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:38.189990 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:38.190158 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing instance network info cache due to event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:38.190378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:38.190489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:38.190633 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:38.221406 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c873b4c6-8a01-4829-a6a8-738fdb752c29 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:38.259796 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Creating config drive at /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.config
May 26 05:05:38.266218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp94byf81u {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:38.322831 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp94byf81u" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:38.338157 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:38.338511 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:38.435046 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:38.435382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:38.435617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:38.436049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:38.436049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:38.441923 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Terminating instance
May 26 05:05:38.591740 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:38.592970 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:38.593689 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Creating image(s)
May 26 05:05:38.594173 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:38.594399 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:38.594861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:38.595449 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:38.598578 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:38.599682 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:38.628418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:38.694046 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:38.697535 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:38.698011 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:38.698529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:38.699118 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:38.702128 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:38.702518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:38.810656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:38.811222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:38.844952 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:38.851638 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:38.888442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:38.895639 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk 1073741824" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:38.896645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:38.896720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:38.926988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:38.947374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:05:38.975419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:38.976779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.005964 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.008277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:39.011588 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:39.011588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:39.034490 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.139079 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:39.141105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Ensure instance console log exists: /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:39.144280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:39.266185 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.276830 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.297943 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999577373000193 future=<Future at 0x7d7ac46f1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:39.298643 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.9988426660002 future=<Future at 0x7d7ac46f1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:39.298813 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998668382000233 future=<Future at 0x7d7ac46f1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:39.301213 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Instance destroyed successfully.
May 26 05:05:39.302030 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'resources' on Instance uuid fa807765-450a-493a-b193-fe0d0fcfcb72 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:39.349237 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.358013 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.362612 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:05:39.363155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.312s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:39.363961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:39.368344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.369295 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:05:39.373665 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:39.373890 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Claim successful on node np0000001388
May 26 05:05:39.394225 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.400265 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.539841 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.577312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.642346 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c6bee19-22a0-46ff-b07c-ae7cb7c26319 req-cb0bc729-cb73-458f-8063-91983e6b784d service nova] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:39.643578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:39.643971 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:39.807221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-459121262',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-459121262',id=27,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4xxuBfN5XfC8GQ/PmzAL+Sn5BJF4iNyTa2EHq4XkewBnlll0B7YKN7cbLviqRLqEZ7K5GLDh2S5HmHHgPjzj/u68f9SpkPm1a8DM0qrKYGyW50BVrBsiLA3xa1yjRcKQ==',key_name='tempest-keypair-1664079945',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:57Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-7o0i121h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=fa807765-450a-493a-b193-fe0d0fcfcb72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:05:39.807406 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "address": "fa:16:3e:b8:9a:c3", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb7ee8de7-e6", "ovs_interfaceid": "b7ee8de7-e65c-4b0f-b64a-2af100a06510", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:39.808033 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:39.808296 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:05:39.809844 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.810053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb7ee8de7-e6, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:39.811109 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.812190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:39.813283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.813809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.813947 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=deb7c3f1-6360-4620-9e03-b3839385a426) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:39.815653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:39.816248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:39.818020 np0000001388 nova-compute[98319]: INFO os_vif [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:9a:c3,bridge_name='br-int',has_traffic_filtering=True,id=b7ee8de7-e65c-4b0f-b64a-2af100a06510,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb7ee8de7-e6')
May 26 05:05:39.818436 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Deleting instance files /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72_del
May 26 05:05:39.827186 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Deletion of /opt/stack/data/nova/instances/fa807765-450a-493a-b193-fe0d0fcfcb72_del complete
May 26 05:05:39.871575 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 23.24 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:39.904386 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771939.9039888, aac0d9b3-054d-4fc0-91f8-fce1d835a7ea => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:39.904565 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] VM Started (Lifecycle Event)
May 26 05:05:40.216217 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:40.258531 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:40.258696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:40.259288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:40.259288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:40.259288 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Processing event network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:05:40.259505 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:40.259505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:40.259575 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:40.259681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:40.259805 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] No waiting events found dispatching network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:40.259929 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received unexpected event network-vif-plugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c for instance with vm_state building and task_state spawning.
May 26 05:05:40.260040 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:40.261110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:40.261110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:40.261731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:40.261731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:40.261731 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:40.261731 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:05:40.261731 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:40.262036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Acquiring lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:40.262036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:40.262036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:40.262221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] No waiting events found dispatching network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:40.262221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2074dfb-9eb2-4550-9e35-2a677626a2ed req-2bc7db27-0c0d-4dac-8a3c-1694aa0d7ca8 service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-unplugged-b7ee8de7-e65c-4b0f-b64a-2af100a06510 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:05:40.266085 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:05:40.268460 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance spawned successfully.
May 26 05:05:40.268909 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:05:40.335513 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Took 1.39 seconds to destroy the instance on the hypervisor.
May 26 05:05:40.338546 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:05:40.338745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:05:40.338898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:05:40.339293 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:40.408640 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:40.410691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:40.434256 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:40.498213 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:40.630307 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:40.778083 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.778284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.778631 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.778915 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.779180 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.779414 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:40.916315 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:40.917665 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771940.9170828, aac0d9b3-054d-4fc0-91f8-fce1d835a7ea => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:40.918386 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] VM Paused (Lifecycle Event)
May 26 05:05:41.135709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:41.135929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance network_info: |[{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:05:41.138289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start _get_guest_xml network_info=[{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:41.142979 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:41.144346 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='67e6c789-cd47-4a9d-85a4-3c51faa4d646'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771941.1438918) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:41.146682 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:41.147039 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:41.149601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:41.149816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:41.151093 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:41.151528 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:41.151684 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:41.152898 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:41.153808 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:41.153808 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:41.154020 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:41.154705 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:41.155285 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:41.155442 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:41.155594 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:41.155707 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:41.155859 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:41.161534 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:41.173028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:41.173239 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:41.174088 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:41.174737 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:41.285193 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Took 8.24 seconds to spawn the instance on the hypervisor.
May 26 05:05:41.285672 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:41.424372 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:41.428929 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771941.4286528, aac0d9b3-054d-4fc0-91f8-fce1d835a7ea => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:41.430568 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] VM Resumed (Lifecycle Event)
May 26 05:05:41.605390 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:41.669970 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:41.677880 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <uuid>67e6c789-cd47-4a9d-85a4-3c51faa4d646</uuid>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <name>instance-00000024</name>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:41</nova:creationTime>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         <nova:port uuid="f0f7ac1e-f1fb-4712-80af-906a91796719">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="serial">67e6c789-cd47-4a9d-85a4-3c51faa4d646</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="uuid">67e6c789-cd47-4a9d-85a4-3c51faa4d646</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:34:86:0d"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <target dev="tapf0f7ac1e-f1"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/console.log" append="off"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:41.677880 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Preparing to wait for external event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:41.680885 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:41.681893 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:41.683559 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:41.688037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.688322 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:41.688533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:41.689607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.689812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627a761e-f6c0-5fe3-9914-4f846acc6ced', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:41.690552 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.691332 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:41.692347 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.696930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.697143 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f7ac1e-f1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:41.697545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0f7ac1e-f1, col_values=(('qos', UUID('d3087f7b-b656-4644-b53d-c7d53cca40b8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:41.697728 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0f7ac1e-f1, col_values=(('external_ids', {'iface-id': 'f0f7ac1e-f1fb-4712-80af-906a91796719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:86:0d', 'vm-uuid': '67e6c789-cd47-4a9d-85a4-3c51faa4d646'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:41.702440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:41.706528 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:41.708011 np0000001388 nova-compute[98319]: INFO os_vif [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1')
May 26 05:05:41.795616 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Took 13.91 seconds to build instance.
May 26 05:05:41.884717 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:05:41.931388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:41.933692 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:42.107521 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Took 1.77 seconds to deallocate network for instance.
May 26 05:05:42.185398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.822s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:42.185823 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:42.211302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:42.298847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.420s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:42.331144 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41f75001-883b-42a6-8c07-44da0d228aa8 req-786b7da2-7324-4f44-9784-82c3865d491b service nova] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Received event network-vif-deleted-b7ee8de7-e65c-4b0f-b64a-2af100a06510 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:42.613446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:42.613694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:42.680673 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Refreshing inventories for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 26 05:05:42.694535 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:42.694805 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:42.695033 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:42.695307 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:42.741638 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Updating ProviderTree inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 26 05:05:42.741835 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 05:05:42.778547 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59079210c217429e88a1c824524b9772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c32d47b7a83249e09dab2cfa30367843', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:42.811988 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Refreshing aggregate associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 26 05:05:42.891782 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Refreshing trait associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, traits: COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 26 05:05:43.198453 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:43.240878 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:43.243505 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:43.243735 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:34:86:0d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:43.244310 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Using config drive
May 26 05:05:43.356221 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Successfully created port: 71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:43.466944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:43.467183 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:43.702745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:43.753701 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:43.933233 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Creating config drive at /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config
May 26 05:05:43.939676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpstua1xoc {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:43.972661 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:44.003190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpstua1xoc" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:44.080147 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Successfully updated port: 71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:44.132490 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-changed-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:44.133016 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Refreshing instance network info cache due to event network-changed-71964717-ea6b-4cd4-b87e-2db4de8c5f1c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:44.133221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] Acquiring lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:44.133329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] Acquired lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:44.133510 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Refreshing network info cache for port 71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:44.486008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.872s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:44.536205 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:44.568886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:44.572587 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Deleted allocations for instance fa807765-450a-493a-b193-fe0d0fcfcb72
May 26 05:05:44.582822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:44.640912 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:44.671160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:44.714792 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:44.718239 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:44.718571 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Creating image(s)
May 26 05:05:44.719250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:44.719472 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:44.720145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:44.720565 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:44.725825 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:44.727122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:44.755683 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:44.762694 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:44.834317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:44.834871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:44.835390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:44.835982 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:44.842097 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:44.842530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:44.972623 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.129s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:44.972971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:45.047999 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:45.051238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk 1073741824" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:45.055314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:45.055314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:45.172886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:45.173528 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:45.173857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:45.279539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:45.279992 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Cannot resize image /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:45.280496 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:45.280978 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Ensure instance console log exists: /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:45.281158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:45.281536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:45.282426 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:45.553144 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-587f4997-173e-4c30-b9a0-db13658ac32f req-45a0dc09-45c1-47f3-9107-9afad447c83a service nova] Releasing lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:45.554029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquired lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:45.554373 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:45.578678 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771945.5782242, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:45.578918 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Started (Lifecycle Event)
May 26 05:05:45.589682 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ee03c41-e067-444d-93bb-acfec7a3f230 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "fa807765-450a-493a-b193-fe0d0fcfcb72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.154s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:46.083029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:46.086500 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771946.0862088, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:46.086725 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Paused (Lifecycle Event)
May 26 05:05:46.149683 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:46.196683 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:46.196951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:46.197165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:46.197389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:46.197552 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Processing event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:05:46.198016 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:46.199137 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:46.199382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:46.199585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:46.199768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:46.199910 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:46.200057 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-7bde2d90-9aea-413a-8774-48f782a6d251 req-2371d159-0266-4d4a-9f36-10e96045e00d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received unexpected event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with vm_state building and task_state spawning.
May 26 05:05:46.203134 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:05:46.209429 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance spawned successfully.
May 26 05:05:46.209429 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:05:46.409513 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:46.590368 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:46.593733 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771946.593313, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:46.593968 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Resumed (Lifecycle Event)
May 26 05:05:46.632849 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating instance_info_cache with network_info: [{"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:46.700079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:46.725397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:46.725547 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:46.726012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:46.726325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:46.726693 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:46.726940 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:47.096556 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:47.097919 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:47.134686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Releasing lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:47.135042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance network_info: |[{"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:05:47.136765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Start _get_guest_xml network_info=[{"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:47.138465 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:47.139592 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesBackupsTest-instance-564208652', uuid='e44fef6b-6d4c-49b1-977e-3d190c009d28'), owner=OwnerMeta(userid='59079210c217429e88a1c824524b9772', username='tempest-VolumesBackupsTest-2047315277-project-member', projectid='c32d47b7a83249e09dab2cfa30367843', projectname='tempest-VolumesBackupsTest-2047315277'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771947.1392953) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:47.140348 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:47.140679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:47.141366 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:47.141553 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:47.142638 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:47.143056 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:47.143228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:47.143365 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:47.143525 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:47.143649 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:47.143786 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:47.144000 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:47.144242 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:47.144388 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:47.144530 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:47.144684 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:47.154653 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-564208652',display_name='tempest-VolumesBackupsTest-instance-564208652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-564208652',id=37,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/dMkcOh3IZEBePi+wK1paytLdf35m4/5dHVwtEDpjI8FiFhXw+cRWrWuCs0I/Nq9Eprn7rVlKUySFsqbMd+tNDn1doy6DKNu/qfzAn5sYxnOfjI6pAXKzZ1fsfY79k5Q==',key_name='tempest-keypair-1870345677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-9x7g0ide',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=e44fef6b-6d4c-49b1-977e-3d190c009d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:47.155145 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:47.155335 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:47.155801 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'pci_devices' on Instance uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:47.209499 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.234451 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Took 8.64 seconds to spawn the instance on the hypervisor.
May 26 05:05:47.234870 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:47.600145 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:47.659425 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <uuid>e44fef6b-6d4c-49b1-977e-3d190c009d28</uuid>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <name>instance-00000025</name>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesBackupsTest-instance-564208652</nova:name>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:47</nova:creationTime>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:user uuid="59079210c217429e88a1c824524b9772">tempest-VolumesBackupsTest-2047315277-project-member</nova:user>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:project uuid="c32d47b7a83249e09dab2cfa30367843">tempest-VolumesBackupsTest-2047315277</nova:project>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         <nova:port uuid="71964717-ea6b-4cd4-b87e-2db4de8c5f1c">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="serial">e44fef6b-6d4c-49b1-977e-3d190c009d28</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="uuid">e44fef6b-6d4c-49b1-977e-3d190c009d28</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.config"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:4e:41:af"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <target dev="tap71964717-ea"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/console.log" append="off"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:47.659425 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:47.661409 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Preparing to wait for external event network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:47.661409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:47.661409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:47.661409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:47.663785 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-564208652',display_name='tempest-VolumesBackupsTest-instance-564208652',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-564208652',id=37,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/dMkcOh3IZEBePi+wK1paytLdf35m4/5dHVwtEDpjI8FiFhXw+cRWrWuCs0I/Nq9Eprn7rVlKUySFsqbMd+tNDn1doy6DKNu/qfzAn5sYxnOfjI6pAXKzZ1fsfY79k5Q==',key_name='tempest-keypair-1870345677',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-9x7g0ide',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=e44fef6b-6d4c-49b1-977e-3d190c009d28,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:47.663979 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:47.664498 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:47.664801 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:47.665172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.665453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:47.665770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:47.666600 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.666802 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '95f9a3da-a123-5d97-847f-8a44b941c35b', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:47.667734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.670021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:47.674216 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.674451 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71964717-ea, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:47.674870 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71964717-ea, col_values=(('qos', UUID('2d6563e8-b05f-4f26-a59d-3da2ebf32840')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:47.675070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71964717-ea, col_values=(('external_ids', {'iface-id': '71964717-ea6b-4cd4-b87e-2db4de8c5f1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:41:af', 'vm-uuid': 'e44fef6b-6d4c-49b1-977e-3d190c009d28'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:47.676173 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.678335 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:47.683981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:47.685222 np0000001388 nova-compute[98319]: INFO os_vif [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea')
May 26 05:05:47.746580 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Took 14.42 seconds to build instance.
May 26 05:05:48.066827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:48.066827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:48.066827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:48.066827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:48.066827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:48.069490 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Terminating instance
May 26 05:05:48.248160 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:48.489301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:48.489657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:48.574277 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:05:48.605235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:48.634628 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:48.668693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:48.709525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:48.709525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing instance network info cache due to event network-changed-5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:48.709685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] Acquiring lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:48.709808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] Acquired lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:48.709941 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Refreshing network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:48.898606 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:48.899174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:48.899490 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:48.899739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:48.899878 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] No waiting events found dispatching network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:48.900013 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e980b8ff-6a9e-4867-93be-0714df82a8db req-1e342d3c-17ed-47c5-a251-1a8770ba5c52 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:05:48.926186 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999567415000001 future=<Future at 0x7d7ac43bc5f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:48.927486 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Instance destroyed successfully.
May 26 05:05:48.927902 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lazy-loading 'resources' on Instance uuid aac0d9b3-054d-4fc0-91f8-fce1d835a7ea {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:48.994650 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:49.210572 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:49.210716 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:49.210878 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No VIF found with MAC fa:16:3e:4e:41:af, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:49.211429 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Using config drive
May 26 05:05:49.213985 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:49.430486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-545887147',display_name='tempest-VolumesActionsTest-instance-545887147',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesactionstest-instance-545887147',id=35,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:41Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='616737caae164e1bb3b0886d8eccdc40',ramdisk_id='',reservation_id='r-yboodc5f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-419857946',owner_user_name='tempest-VolumesActionsTest-419857946-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:05:41Z,user_data=None,user_id='5e648294e50d4dabbb49fc071dc1a56f',uuid=aac0d9b3-054d-4fc0-91f8-fce1d835a7ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:05:49.430857 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converting VIF {"id": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "address": "fa:16:3e:41:1c:0e", "network": {"id": "1ba0b9e3-97b1-445e-984a-d003ea6f5eb3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1389441672-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "616737caae164e1bb3b0886d8eccdc40", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap42b1a1a6-b7", "ovs_interfaceid": "42b1a1a6-b799-4fa4-b382-2af64f6f084c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:49.431398 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:49.431678 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:05:49.433385 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.433616 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42b1a1a6-b7, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:49.434661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.435526 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:49.443337 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.445477 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.445697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72cf368b-4f51-48c2-ad7f-76ebbe8f59d6) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:49.449247 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.450293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:49.454587 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:49.456887 np0000001388 nova-compute[98319]: INFO os_vif [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:1c:0e,bridge_name='br-int',has_traffic_filtering=True,id=42b1a1a6-b799-4fa4-b382-2af64f6f084c,network=Network(1ba0b9e3-97b1-445e-984a-d003ea6f5eb3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42b1a1a6-b7')
May 26 05:05:49.457294 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Deleting instance files /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea_del
May 26 05:05:49.458558 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Deletion of /opt/stack/data/nova/instances/aac0d9b3-054d-4fc0-91f8-fce1d835a7ea_del complete
May 26 05:05:49.582846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:49.583064 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:49.590281 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:49.590281 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Claim successful on node np0000001388
May 26 05:05:49.638052 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:49.721794 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:49.836500 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updated VIF entry in instance network info cache for port 5decd3eb-d9e7-472e-b37b-ac70248fe91b. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:49.837552 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating instance_info_cache with network_info: [{"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:49.873587 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Creating config drive at /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.config
May 26 05:05:49.879571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpehz13lt5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:49.933162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpehz13lt5" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:49.969904 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:05:49.974977 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:05:49.974977 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:05:49.974977 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:05:49.974977 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:50.112354 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:50.331250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:50.331528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:50.338889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccbbaf19-96a6-48a1-951e-ff489f7dad01 req-e62fc0ed-8be3-46eb-9cd6-662470275540 service nova] Releasing lock "refresh_cache-a921deec-f5fe-4c81-a5c2-df30f947a826" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:50.566007 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:50.579687 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:50.599287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:50.605254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:50.817493 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:50.818131 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing instance network info cache due to event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:50.819369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:50.820553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:50.821350 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:50.836161 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:05:50.911325 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] Acquiring lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] No waiting events found dispatching network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:51.040943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaba9231-0902-4e8f-9e29-54061b17c085 req-8c74ab43-3904-467a-a838-209d91be7ad0 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-unplugged-42b1a1a6-b799-4fa4-b382-2af64f6f084c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:05:51.054320 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:51.057015 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:51.060115 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:51.062703 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:51.092812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:51.327594 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:51.399530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:51.399530 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:51.416951 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Took 1.44 seconds to deallocate network for instance.
May 26 05:05:51.438451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:51.655382 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771951.6550367, e44fef6b-6d4c-49b1-977e-3d190c009d28 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:51.655549 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] VM Started (Lifecycle Event)
May 26 05:05:51.757654 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:51.902779 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:51.912398 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updated VIF entry in instance network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:51.912722 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:51.934141 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:52.248480 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:52.267691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:52.272414 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771952.2720566, e44fef6b-6d4c-49b1-977e-3d190c009d28 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:52.272617 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] VM Paused (Lifecycle Event)
May 26 05:05:52.415812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.833s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:52.417537 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:52.421650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:52.422058 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Received event network-vif-deleted-42b1a1a6-b799-4fa4-b382-2af64f6f084c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:52.422309 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Neutron deleted interface 42b1a1a6-b799-4fa4-b382-2af64f6f084c; detaching it from the instance and deleting it from the info cache
May 26 05:05:52.422588 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:52.424494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.986s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:52.430239 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:05:52.430239 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Claim successful on node np0000001388
May 26 05:05:52.776081 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:52.777750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:52.897884 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:52.898071 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:52.898267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:52.898397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:52.898782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Processing event network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:05:52.898782 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:52.898844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:52.898949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:52.899058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:52.899181 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] No waiting events found dispatching network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:05:52.899319 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-56f66b1e-634c-4383-b588-c96c60e3a479 req-a380c8b5-179c-41e1-9f82-fd0cc73350a9 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received unexpected event network-vif-plugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c for instance with vm_state building and task_state spawning.
May 26 05:05:52.900075 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:05:52.903651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:05:52.906359 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance spawned successfully.
May 26 05:05:52.906801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:05:52.927479 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:52.927644 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:52.927939 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:52.928250 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:52.931513 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95eca9c3-90e9-45c5-a33f-4b4db4aaab68 req-f343d1ca-1e3d-4b54-b959-cbaf979944a5 service nova] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Detach interface failed, port_id=42b1a1a6-b799-4fa4-b382-2af64f6f084c, reason: Instance aac0d9b3-054d-4fc0-91f8-fce1d835a7ea could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:05:53.021128 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fdb1ab2deb1f45f3a5cb5374e0e8dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6925a7d36eb4b919388468635037918', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:53.280435 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:53.280696 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771953.2805066, e44fef6b-6d4c-49b1-977e-3d190c009d28 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:53.280848 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] VM Resumed (Lifecycle Event)
May 26 05:05:53.412959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.413110 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.413333 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.413589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.413909 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.414184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:05:53.431807 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:53.606856 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Successfully created port: 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:53.785062 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:53.787526 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:05:53.920713 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Took 9.21 seconds to spawn the instance on the hypervisor.
May 26 05:05:53.922347 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:53.935229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:54.124217 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:54.124422 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:54.294424 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:05:54.298233 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000697602999935043 future=<Future at 0x7d7ac46f1670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:54.298367 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:54.298495 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.627196828000251 future=<Future at 0x7d7ac43bc5f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:54.298585 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.627099505999922 future=<Future at 0x7d7ac43bc5f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:05:54.298946 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779771939.2973554, fa807765-450a-493a-b193-fe0d0fcfcb72 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:05:54.299094 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] VM Stopped (Lifecycle Event)
May 26 05:05:54.311637 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Successfully updated port: 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:54.436497 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Took 17.14 seconds to build instance.
May 26 05:05:54.451029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:54.627126 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:54.802110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dbc8950-86d1-432c-bf1c-51186a442274 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: fa807765-450a-493a-b193-fe0d0fcfcb72] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:05:54.814396 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:54.814553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:54.814634 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:54.937733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.646s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:54.953852 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:54.954775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:54.955025 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating image(s)
May 26 05:05:54.955493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:54.955662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:54.956323 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:54.963502 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:54.971483 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:54.975145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:55.000331 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:55.000569 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing instance network info cache due to event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:55.001591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:55.098645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:55.099852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:55.100032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:55.100487 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:55.104500 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:55.105369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:55.138304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.713s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:55.143255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.204s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:55.143255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:05:55.211704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:55.212166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:55.290246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk 1073741824" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:55.290246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:55.290246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:55.406525 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:55.418016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.132s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:55.418408 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:55.418713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:55.524058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:55.524536 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Cannot resize image /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:55.524985 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:55.525210 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Ensure instance console log exists: /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:55.525676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:55.526168 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:55.526384 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:55.663387 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:05:55.663387 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:05:55.663387 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:55.663587 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:55.675009 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:55.791486 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:05:55.924102 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:55.977457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:05:55.977967 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:05:56.164652 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:05:56.234733 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-changed-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:56.234951 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Refreshing instance network info cache due to event network-changed-71964717-ea6b-4cd4-b87e-2db4de8c5f1c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:56.235175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] Acquiring lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:56.235415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] Acquired lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:56.235588 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Refreshing network info cache for port 71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:56.414489 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Successfully created port: a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:05:56.431289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:56.431289 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance network_info: |[{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:05:56.431289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:56.431289 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:56.434438 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start _get_guest_xml network_info=[{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:05:56.441819 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:05:56.444085 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-97965079', uuid='c6aa2167-8fa0-4795-9166-36d8a29c477a'), owner=OwnerMeta(userid='fdb1ab2deb1f45f3a5cb5374e0e8dea1', username='tempest-AttachVolumeShelveTestJSON-946543145-project-member', projectid='b6925a7d36eb4b919388468635037918', projectname='tempest-AttachVolumeShelveTestJSON-946543145'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771956.4436743) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:05:56.445995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:05:56.446478 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:05:56.448223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:05:56.448491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:05:56.449786 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:05:56.451160 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:05:56.451595 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:05:56.453283 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:05:56.474366 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPMxUQzoIudUsr7giSdmJtCmDmteNUA+Fv8w2zZXDygF4TeUGoF39pC/VETxTJVPT7Gg8Oa6aT9Z2V0kbJ9zZ3bKJ43KEBJKqg11cEMim1aeTo+q5MNnl8M0B2/qddPig==',key_name='tempest-keypair-1986219734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:05:56.475571 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:56.475571 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:56.475991 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_devices' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:05:56.481182 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:05:56.668815 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:05:56.738295 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:56.937359 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:56.983228 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] End _get_guest_xml xml=<domain type="qemu">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <uuid>c6aa2167-8fa0-4795-9166-36d8a29c477a</uuid>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <name>instance-00000026</name>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-97965079</nova:name>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:05:56</nova:creationTime>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:user uuid="fdb1ab2deb1f45f3a5cb5374e0e8dea1">tempest-AttachVolumeShelveTestJSON-946543145-project-member</nova:user>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:project uuid="b6925a7d36eb4b919388468635037918">tempest-AttachVolumeShelveTestJSON-946543145</nova:project>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         <nova:port uuid="0504e6f4-659f-4a72-858a-d5dca4e68565">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <system>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="serial">c6aa2167-8fa0-4795-9166-36d8a29c477a</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="uuid">c6aa2167-8fa0-4795-9166-36d8a29c477a</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </system>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <os>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </os>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <features>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </features>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   <devices>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </disk>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a5:27:7f"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <target dev="tap0504e6f4-65"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </interface>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/console.log" append="off"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </serial>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <video>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </video>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </rng>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:   </devices>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]: </domain>
May 26 05:05:56.983228 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Preparing to wait for external event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPMxUQzoIudUsr7giSdmJtCmDmteNUA+Fv8w2zZXDygF4TeUGoF39pC/VETxTJVPT7Gg8Oa6aT9Z2V0kbJ9zZ3bKJ43KEBJKqg11cEMim1aeTo+q5MNnl8M0B2/qddPig==',key_name='tempest-keypair-1986219734',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:56.988988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:05:56.990190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.852s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:56.991822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:56.992219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3df61656-0887-5ed3-a334-0b12f1f802a9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:56.993570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:56.996070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:57.001461 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:57.001797 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0504e6f4-65, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:57.002414 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0504e6f4-65, col_values=(('qos', UUID('189f1fd6-622f-4899-b69c-0eb9f7687fa1')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:57.003490 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0504e6f4-65, col_values=(('external_ids', {'iface-id': '0504e6f4-659f-4a72-858a-d5dca4e68565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:27:7f', 'vm-uuid': 'c6aa2167-8fa0-4795-9166-36d8a29c477a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:05:57.005260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:57.007173 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:05:57.019546 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:57.020622 np0000001388 nova-compute[98319]: INFO os_vif [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65')
May 26 05:05:57.074323 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Deleted allocations for instance aac0d9b3-054d-4fc0-91f8-fce1d835a7ea
May 26 05:05:57.082117 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Successfully updated port: a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:05:57.149546 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:05:57.149685 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing instance network info cache due to event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:05:57.149868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:57.150002 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:57.150101 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:05:57.155306 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:57.220366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:57.330600 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updated VIF entry in instance network info cache for port 71964717-ea6b-4cd4-b87e-2db4de8c5f1c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:57.330892 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating instance_info_cache with network_info: [{"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:57.333443 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:57.496844 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updated VIF entry in instance network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:05:57.497135 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:57.589955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:05:57.653251 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:57.681430 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:05:57.682572 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:05:57.682959 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Creating image(s)
May 26 05:05:57.684500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:57.684500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:57.685162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:57.685977 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:57.690858 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:57.692512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:57.764727 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:57.804324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:57.804825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:57.807662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:57.813549 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:57.817004 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:05:57.817424 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:57.838176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f4d78919-2ed1-4eaa-b2b6-0eec387edf73 req-7042be3b-6293-42cd-b35b-2b9a3ac01fd2 service nova] Releasing lock "refresh_cache-e44fef6b-6d4c-49b1-977e-3d190c009d28" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:57.920325 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:57.920921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:57.975813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:57.976958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:57.977370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:58.003816 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5d37621d-b03d-4cac-ab51-287e5b381f12 req-abb502b0-6e38-4eb8-bcf9-ad240f65fe47 service nova] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:58.012821 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:58.087017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-15d68e71-ada4-4979-babf-f2160825d8a2 tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Lock "aac0d9b3-054d-4fc0-91f8-fce1d835a7ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.022s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:58.094664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:58.096120 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:05:58.096467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:58.196130 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:58.196450 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:05:58.196831 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:05:58.197008 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Ensure instance console log exists: /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:05:58.199492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:05:58.199814 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:05:58.199985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:05:58.517065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9ed82c57-4cfb-4ea6-9115-9dac0a11e194 req-9b37329e-3d07-4b77-9e4c-5eeb4171fb63 service nova] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:05:58.517625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:05:58.518051 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:05:58.545312 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:58.545312 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:05:58.545312 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No VIF found with MAC fa:16:3e:a5:27:7f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:05:58.545312 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Using config drive
May 26 05:05:59.057042 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:59.143260 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:05:59.256443 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating config drive at /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config
May 26 05:05:59.261684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoyqycwva {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:05:59.320661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoyqycwva" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:05:59.397366 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:05:59.580930 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:05:59.827911 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:59.858804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:59.861054 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:05:59.965543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.084229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:00.084803 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance network_info: |[{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:06:00.087772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start _get_guest_xml network_info=[{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:06:00.111066 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:00.111066 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='7583fee2-acf9-4217-ad23-adca4ec3e186'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779771960.108177) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:06:00.114554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-908c13b4-63d9-42c2-88d9-6b85f6ca0102 req-ff921180-260c-4ec8-baf7-4075dbd17cc4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:00.114808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-908c13b4-63d9-42c2-88d9-6b85f6ca0102 req-ff921180-260c-4ec8-baf7-4075dbd17cc4 service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:00.115604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-908c13b4-63d9-42c2-88d9-6b85f6ca0102 req-ff921180-260c-4ec8-baf7-4075dbd17cc4 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:00.115844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-908c13b4-63d9-42c2-88d9-6b85f6ca0102 req-ff921180-260c-4ec8-baf7-4075dbd17cc4 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:00.116005 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-908c13b4-63d9-42c2-88d9-6b85f6ca0102 req-ff921180-260c-4ec8-baf7-4075dbd17cc4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Processing event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:06:00.116349 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:06:00.118571 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:06:00.121368 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:06:00.122336 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:06:00.123101 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:06:00.123637 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:06:00.124224 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:06:00.124224 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:06:00.124936 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:06:00.128404 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:06:00.128404 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:06:00.128980 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:06:00.129319 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:06:00.129375 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:06:00.129663 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:06:00.129931 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:06:00.153841 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:06:00.153841 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:00.154411 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:00.156034 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:00.360223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.391508 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.659813 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] End _get_guest_xml xml=<domain type="qemu">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <uuid>7583fee2-acf9-4217-ad23-adca4ec3e186</uuid>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <name>instance-00000027</name>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:06:00</nova:creationTime>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         <nova:port uuid="a8308c82-1af4-4f92-9424-20cd5c165b63">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <system>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="serial">7583fee2-acf9-4217-ad23-adca4ec3e186</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="uuid">7583fee2-acf9-4217-ad23-adca4ec3e186</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </system>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <os>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </os>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <features>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </features>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   <devices>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:44:cc:e2"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <target dev="tapa8308c82-1a"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </interface>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/console.log" append="off"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </serial>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <video>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </video>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </rng>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:   </devices>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]: </domain>
May 26 05:06:00.659813 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Preparing to wait for external event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:05:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:00.663413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:06:00.664073 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.664659 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f23a7f7-5141-5f2b-beec-2672eac29e3c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:00.668651 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:00.670592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.670857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8308c82-1a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:00.671273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8308c82-1a, col_values=(('qos', UUID('069eb252-94ad-46ec-9195-d2ad47b9ea2e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:00.671493 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8308c82-1a, col_values=(('external_ids', {'iface-id': 'a8308c82-1af4-4f92-9424-20cd5c165b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:cc:e2', 'vm-uuid': '7583fee2-acf9-4217-ad23-adca4ec3e186'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:00.674448 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:00.679926 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:00.681480 np0000001388 nova-compute[98319]: INFO os_vif [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a')
May 26 05:06:00.950163 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771960.9494936, c6aa2167-8fa0-4795-9166-36d8a29c477a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:00.950163 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Started (Lifecycle Event)
May 26 05:06:00.952621 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:06:00.955650 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:06:00.958464 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance spawned successfully.
May 26 05:06:00.959260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:06:01.456096 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:01.460112 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:01.466942 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.467561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.468181 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.468181 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.469370 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.470796 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:01.965479 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:01.965792 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771961.9655662, c6aa2167-8fa0-4795-9166-36d8a29c477a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:01.966814 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Paused (Lifecycle Event)
May 26 05:06:01.977431 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Took 7.02 seconds to spawn the instance on the hypervisor.
May 26 05:06:01.977685 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:02.194334 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:02.194774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:02.196012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:02.196012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:02.196012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:02.196012 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-92c5539f-0192-434e-a952-9a8f9dc8414f req-79ef93cd-c298-4a17-9241-0afd60d1af3f service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received unexpected event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with vm_state active and task_state None.
May 26 05:06:02.200941 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:02.201139 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:02.201478 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:44:cc:e2, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:02.202594 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Using config drive
May 26 05:06:02.227944 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:02.469788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:02.473901 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771962.473565, c6aa2167-8fa0-4795-9166-36d8a29c477a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:02.475014 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Resumed (Lifecycle Event)
May 26 05:06:02.488784 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Took 12.99 seconds to build instance.
May 26 05:06:02.709817 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:02.877775 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Creating config drive at /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config
May 26 05:06:02.881230 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8c0l8qw6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:02.952337 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8c0l8qw6" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:02.986515 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:02.990869 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:02.996438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.506s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:03.108476 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:03.487101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:03.521727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:03.525019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:03.633726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:03.728134 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 07d0130e-910b-4ab0-8c20-b2fbde08ac3c {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.729464 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.730752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.731165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.732392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.734022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.734022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.737555 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.738091 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:03.738515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.738743 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.740804 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.742303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.745450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.746234 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.747554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.747554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.747554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:06:03.748320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.749118 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.751405 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 20.39 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:03.822098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58c0e0b6-6c30-4f8a-a09f-52af8ba7a92f req-000e0da8-ebf2-4234-bc32-2d4abac2f4bd service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:03.826989 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58c0e0b6-6c30-4f8a-a09f-52af8ba7a92f req-000e0da8-ebf2-4234-bc32-2d4abac2f4bd service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:03.830216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58c0e0b6-6c30-4f8a-a09f-52af8ba7a92f req-000e0da8-ebf2-4234-bc32-2d4abac2f4bd service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:03.830216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-58c0e0b6-6c30-4f8a-a09f-52af8ba7a92f req-000e0da8-ebf2-4234-bc32-2d4abac2f4bd service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:03.830216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-58c0e0b6-6c30-4f8a-a09f-52af8ba7a92f req-000e0da8-ebf2-4234-bc32-2d4abac2f4bd service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Processing event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:06:03.927044 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0012158129998169898 future=<Future at 0x7d7ac43bc5f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:03.928243 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779771948.9256182, aac0d9b3-054d-4fc0-91f8-fce1d835a7ea => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:03.928243 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:03.928243 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] VM Stopped (Lifecycle Event)
May 26 05:06:03.981125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:04.251752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.519s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.251752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:04.251752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:04.259283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.524s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.259283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:04.259631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:04.260114 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.521s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.260387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:04.262190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.262438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:04.262564 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:04.268467 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:04.269362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.523s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.271797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.288s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:04.280367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing instance network info cache due to event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:04.280666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:04.280879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:04.281216 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:04.431106 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: aac0d9b3-054d-4fc0-91f8-fce1d835a7ea] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:04.433709 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:06:04.435962 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771964.4340847, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:04.435962 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Started (Lifecycle Event)
May 26 05:06:04.440935 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:06:04.450060 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance spawned successfully.
May 26 05:06:04.450480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:06:04.762575 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.788283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.528s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.792875 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:04.793627 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:04.798296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.529s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:04.938283 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:04.939558 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:04.962154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:04.962340 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:04.962922 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:04.963311 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:04.964245 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:04.964523 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:05.252009 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:05.443379 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:05.443379 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771965.4420886, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:05.443379 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Paused (Lifecycle Event)
May 26 05:06:05.446261 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updated VIF entry in instance network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:06:05.446587 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:05.471031 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Took 7.79 seconds to spawn the instance on the hypervisor.
May 26 05:06:05.471681 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:05.681364 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:05.805593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.536s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:05.922842 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d0b290f2-4398-48de-ad38-8e68ff861056 req-d1817df7-e494-4373-b884-6d00c96bfa76 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received unexpected event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with vm_state active and task_state None.
May 26 05:06:05.945438 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:05.947697 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779771965.947336, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:05.947869 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Resumed (Lifecycle Event)
May 26 05:06:05.949076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9f04e21c-d8f0-4712-b53d-115c3b7d361e req-e5b1f8b9-591f-43b1-97ed-6ec419d4cae4 service nova] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:05.984797 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Took 14.64 seconds to build instance.
May 26 05:06:06.137031 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:06.137207 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:06.137524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:06.137761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:06.139045 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:06.140477 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Terminating instance
May 26 05:06:06.451052 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:06.452563 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:06.486629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7ef6f1c9-ea22-4b79-b16d-c02637d129df tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:06.487357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.226s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:06.487655 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:06.487811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:06.568269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:06.568269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:06.568269 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attaching volume f6ec40b3-38e6-4855-b5e2-8741f6d592e7 to /dev/vdb
May 26 05:06:06.604887 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:06.618285 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:06.644358 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:06:06.647018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:06.695041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:06.712919 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:06.714018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:06.726445 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:06.728022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:06.730090 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe48:6af6', 'fe80::b4ef:bfff:fe01:45f2', 'fe80::c08b:afff:fe43:df92', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:06:06.730301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:06.730476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:06.730818 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:06.731158 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating existing volume attachment record: b00a5134-b584-4871-a17a-42fcdea780e5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:06:06.742241 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:06.779483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:06.996268 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.004031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.027815 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99934129300027 future=<Future at 0x7d7ac436c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:07.028951 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998570105999988 future=<Future at 0x7d7ac436c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:07.028951 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998331533000055 future=<Future at 0x7d7ac436c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:07.031632 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Instance destroyed successfully.
May 26 05:06:07.033301 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lazy-loading 'resources' on Instance uuid 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:07.229751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.304208 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:07.304575 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:07.304721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:07.305217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:07.305408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:07.319304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:07.319771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:07.320218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:07.321633 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:07.321791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:07.321993 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:07.336875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:07.336875 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:07.343468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:07.343468 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:07.352189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7] added
May 26 05:06:07.352189 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:07.352189 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:07.352189 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:07.352189 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:07.352189 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:07.352189 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:07.352510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:07.352552 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0321(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:07.352707 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:07.356349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7] added
May 26 05:06:07.356349 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:07.356349 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:07.356349 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:07.356349 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:07.356349 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:07.356349 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:07.356618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:07.356801 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:07.357006 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:07.535584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1324898471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serveractionsv293testjson-server-637693764',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDAusXb+VjQiNsp4LSoCwqqVLbKIQHTHG6/GLNukEr8NHFyLnaLtEh8oSi2fB39otDkK5DcDQV+dYRu4NDTGIzch6yHfbSrqbByWn4wxo3yTpHxrJ7eIencoL8tAn7DJg==',key_name='tempest-keypair-1587579465',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:27Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9b6c6daea7064df7973a1e2e20e2582f',ramdisk_id='',reservation_id='r-eqrqjsop',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7353cfc8-6605-4735-b2e1-84717957e228',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1167911011',owner_user_name='tempest-ServerActionsV293TestJSON-1167911011-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:05:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e0939d86f1084b2c982cd2582f27ad96',uuid=569c7477-611f-4fc2-bbc9-b6ce2a2c92d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:06:07.535948 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converting VIF {"id": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "address": "fa:16:3e:08:35:60", "network": {"id": "efc73ec6-382b-4135-9be6-6a54030dd715", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-273104844-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9b6c6daea7064df7973a1e2e20e2582f", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap676f5209-3a", "ovs_interfaceid": "676f5209-3ac4-47fa-99ef-82e1fbd9de7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:07.538033 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:07.538314 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:06:07.541942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.541942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap676f5209-3a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:07.543274 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.545220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:07.545835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.545967 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff15137f-7d1e-4d2e-87bd-76cd7ca84a9e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:07.548338 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:07.549134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:07.553643 np0000001388 nova-compute[98319]: INFO os_vif [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:35:60,bridge_name='br-int',has_traffic_filtering=True,id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f,network=Network(efc73ec6-382b-4135-9be6-6a54030dd715),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap676f5209-3a')
May 26 05:06:07.555691 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:06:07.556022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:07.556215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:07.990123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:07.990736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:07.990966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:07.991147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:07.991309 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:07.991438 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:06:07.991564 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:07.991720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Acquiring lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:07.991870 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:07.992003 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:07.992161 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] No waiting events found dispatching network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:07.992401 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d90583cc-8911-4721-b6df-a5dd5a78c581 req-1dbb2609-3586-4196-abb3-8cab5f2d2d5b service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-unplugged-676f5209-3ac4-47fa-99ef-82e1fbd9de7f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:06:08.053380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:08.057608 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing instance network info cache due to event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:08.057906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:08.058065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:08.058291 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:08.353443 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:08.357721 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:08.373935 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:08.373935 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:08.376519 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:08.376519 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.390264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.396507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.411936 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:08.415865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.415865 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.415865 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.415865 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.415865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:08.416090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.416090 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.416090 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.416090 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.416090 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:08.449469 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.50.100,3260]
May 26 05:06:08.449469 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.50.100,3260] successful.
May 26 05:06:08.449469 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.462021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.468782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.40.100,3260]
May 26 05:06:08.468782 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.40.100,3260] successful.
May 26 05:06:08.468782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.481264 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:08.481264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:08.481945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:08.483580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] HCTL ('7', '-', '-', 0) found on session 95 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:08.483580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:08.502482 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:08.502482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:08.503064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:08.504986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching for a device in session 95 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:08.504986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:08.504986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] HCTL ('8', '-', '-', 0) found on session 96 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:08.504986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:08.522779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching for a device in session 96 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:08.522779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:08.564827 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:08.932858 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:09.083684 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updated VIF entry in instance network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:06:09.084031 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:09.321265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:06:09.588151 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6da809a3-5251-4b7b-88b7-234cffdd7770 req-190f136b-f26b-424d-a87b-6a8eb39e09f4 service nova] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:09.850525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:09.851928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:10.132803 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:10.133357 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing instance network info cache due to event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:10.133598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:10.133815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:10.135282 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:10.341861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found WWN 330000000c8e054c0 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:06:10.342429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:10.342946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000c8e054c0', 'path': '/dev/dm-0', 'multipath_id': '330000000c8e054c0'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:10.343388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.787s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:10.344062 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c8e054c0', 'path': '/dev/dm-0', 'multipath_id': '330000000c8e054c0'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:06:10.344381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:06:10.344609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:06:10.347241 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:10.355188 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:10.381441 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: tcp: [92] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: tcp: [93] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:10.381665 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:10.381830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '93'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '96')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:06:10.381921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '92')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:10.383315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0', '93')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:10.384213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c2ac0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'): ({'sdh'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:06:10.384439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Removing multipathed devices sde, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:06:10.384706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Flush multipath device 330000000446e21b4 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:06:10.440247 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:10.488004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:10.538716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Checking to see if SCSI volumes sde, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:06:10.539017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] SCSI volumes sde, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:06:10.540384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Checking to see if device paths {'sde', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:06:10.555560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Device paths {'sde', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:06:10.555852 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:06:10.569876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.600913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 92, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260]
May 26 05:06:10.600913 np0000001388 nova-compute[98319]: Logout of [sid: 92, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.40.100,3260] successful.
May 26 05:06:10.600913 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.619115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.631564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.640228 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:10.664069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 93, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260]
May 26 05:06:10.664069 np0000001388 nova-compute[98319]: Logout of [sid: 93, target: iqn.2023-03.storpool.com:os--volume-27dd5aab-e57a-48be-8f31-bc0bf7b55ad0, portal: 192.168.50.100,3260] successful.
May 26 05:06:10.664069 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.682021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:10.682211 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:10.682333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] <== disconnect_volume: return (3125ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:10.682438 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:06:10.682688 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deleting instance files /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1_del
May 26 05:06:10.683157 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deletion of /opt/stack/data/nova/instances/569c7477-611f-4fc2-bbc9-b6ce2a2c92d1_del complete
May 26 05:06:10.851563 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attempting to attach volume f6ec40b3-38e6-4855-b5e2-8741f6d592e7 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:06:10.854822 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:   <alias name="ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7"/>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:   <serial>f6ec40b3-38e6-4855-b5e2-8741f6d592e7</serial>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:10.854822 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:06:11.014149 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:11.180323 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updated VIF entry in instance network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:06:11.180772 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:11.189162 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Took 4.54 seconds to destroy the instance on the hypervisor.
May 26 05:06:11.189894 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:06:11.190222 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:06:11.190719 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:06:11.190719 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:11.261120 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:11.366011 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:11.682920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a3c375a3-5fcf-49f6-96f3-35b7ab61a734 req-e4d1dead-70c0-4a3c-acbe-0b5187a95cce service nova] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:11.795216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-15c53de1-7a30-4a34-b263-7b449089fab1 req-8d3afca5-6f64-4265-83f6-8c74c30d74f1 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Received event network-vif-deleted-676f5209-3ac4-47fa-99ef-82e1fbd9de7f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:11.796008 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-15c53de1-7a30-4a34-b263-7b449089fab1 req-8d3afca5-6f64-4265-83f6-8c74c30d74f1 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Neutron deleted interface 676f5209-3ac4-47fa-99ef-82e1fbd9de7f; detaching it from the instance and deleting it from the info cache
May 26 05:06:11.796218 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-15c53de1-7a30-4a34-b263-7b449089fab1 req-8d3afca5-6f64-4265-83f6-8c74c30d74f1 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:12.231544 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:12.234586 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:12.301948 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-15c53de1-7a30-4a34-b263-7b449089fab1 req-8d3afca5-6f64-4265-83f6-8c74c30d74f1 service nova] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Detach interface failed, port_id=676f5209-3ac4-47fa-99ef-82e1fbd9de7f, reason: Instance 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:06:12.466897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:12.466897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:12.467191 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attaching volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 to /dev/vdb
May 26 05:06:12.520082 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:12.533589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:12.551356 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:12.559655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:12.584423 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:12.584601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:12.585578 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:12.585957 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No VIF found with MAC fa:16:3e:48:6a:f6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:12.605531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:12.605934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:12.617270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:12.618652 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe48:6af6', 'fe80::b4ef:bfff:fe01:45f2', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:06:12.619362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:12.619498 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:12.619849 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:12.620099 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating existing volume attachment record: c59d6670-e085-422a-bd65-8ba21a6ffc4c {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:06:12.736869 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Took 1.55 seconds to deallocate network for instance.
May 26 05:06:13.201025 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:13.201557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:13.201831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:13.202454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:13.202721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:13.221736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:13.222389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:13.222893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:13.223150 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:13.223551 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:13.223835 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:13.239370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:13.239370 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:13.239877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:13.239877 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:13.257038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23] added
May 26 05:06:13.257038 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:13.257038 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:13.257038 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:13.257038 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:13.257038 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:13.257038 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:13.257289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:13.257378 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0342(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:13.257510 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:13.259680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23] added
May 26 05:06:13.259680 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:13.259680 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:13.259680 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:13.259680 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:13.259680 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:13.259680 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:13.259867 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:13.260086 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0363(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:13.263449 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:13.312508 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Took 0.58 seconds to detach 1 volumes for instance.
May 26 05:06:13.316173 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Deleting volume: 27dd5aab-e57a-48be-8f31-bc0bf7b55ad0 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:06:13.562155 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:13.864953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:13.865648 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:14.167094 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-88639ef8-0ea1-4266-b60d-c2d5d74d0a12 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.601s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:14.258066 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:14.264152 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:14.280452 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:14.280452 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:14.288443 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:14.288443 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.300775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.316002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.317413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.317413 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.317413 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.317413 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.317413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:14.317663 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.317663 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.317663 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.317663 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.317663 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:14.334413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.334413 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.334413 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.334413 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.334413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:14.334621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.334621 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.334621 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.334621 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.334621 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:14.367459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.40.100,3260]
May 26 05:06:14.367459 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.40.100,3260] successful.
May 26 05:06:14.367459 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.375766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.50.100,3260]
May 26 05:06:14.375766 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.50.100,3260] successful.
May 26 05:06:14.375766 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.387598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.397582 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.408007 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.408508 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:14.408811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.186s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:14.409079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:14.410786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('9', '-', '-', 0) found on session 97 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:14.412342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:14.420660 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:14.421219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:14.421219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:14.421996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('10', '-', '-', 0) found on session 98 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:14.422245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:14.441471 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 97 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:14.441471 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:14.478377 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 98 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:14.478377 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:14.609802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:14.609802 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:15.112912 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:15.224659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:06:15.623698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.755s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:15.689062 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Deleted allocations for instance 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1
May 26 05:06:15.845886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:15.846088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:16.001554 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:16.243172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 33000000098d416b2 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:06:16.244721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:16.244721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:16.244721 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:06:16.252766 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:16.353887 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:16.699343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-832f9349-1755-4a77-9e72-763e6fc6dbed tempest-ServerActionsV293TestJSON-1167911011 tempest-ServerActionsV293TestJSON-1167911011-project-member] Lock "569c7477-611f-4fc2-bbc9-b6ce2a2c92d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.562s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:16.760534 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attempting to attach volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:06:16.762362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:16.762362 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:06:17.236745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:17.361629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:17.554467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:18.429576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:18.429576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:18.429576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:18.429576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:34:86:0d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:18.580536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:18.580722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:18.580928 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attaching volume 100445b9-af37-4fc5-b5e8-71cc938dab8b to /dev/vdc
May 26 05:06:18.622297 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:18.635067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:18.661090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:18.711641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:18.712015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:18.722927 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:18.724309 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe48:6af6', 'fe80::b4ef:bfff:fe01:45f2', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:06:18.724460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:18.724575 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:18.724823 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:18.725062 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating existing volume attachment record: f48b5102-cfb5-412c-9ca7-3b32b480296d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:06:19.297327 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:19.297772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:19.297948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:19.298497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:19.298740 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:19.311303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:19.311995 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:19.312528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:19.315042 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:19.316548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:19.316895 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:19.329682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:19.329682 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:19.335834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:19.335834 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:19.345847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b] added
May 26 05:06:19.345847 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:19.345847 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:19.345847 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:19.345847 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:19.345847 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:19.345847 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:19.346184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:19.346320 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0334(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:19.346510 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:19.351569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b] added
May 26 05:06:19.351569 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:19.351569 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:19.351569 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:19.351569 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:19.351569 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:19.351569 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:19.351860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:19.351970 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0351(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:19.352166 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:19.653995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:19.891396 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:19.891842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:20.005498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e5bc406-dbea-49e9-91ff-ddf233e9b090 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.539s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:20.347017 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:20.353236 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:20.361961 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:20.361961 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:20.372366 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:20.372366 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.383309 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.392264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.396295 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405193 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405537 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.405898 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.406125 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:20.452056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.50.100,3260]
May 26 05:06:20.452056 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.50.100,3260] successful.
May 26 05:06:20.452056 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.454463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.40.100,3260]
May 26 05:06:20.454463 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.40.100,3260] successful.
May 26 05:06:20.454463 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.469767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.482219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.489955 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.490354 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:20.490837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:20.491011 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:20.492486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] HCTL ('11', '-', '-', 0) found on session 99 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:20.492592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.502587 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:20.502982 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:20.503889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:20.504473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:20.505863 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] HCTL ('12', '-', '-', 0) found on session 100 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:20.506075 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:20.514666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching for a device in session 99 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:20.514666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:20.527300 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching for a device in session 100 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:21.403568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:21.529330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Searching for a device in session 100 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:21.529547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:22.027562 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00046791799968559644 future=<Future at 0x7d7ac436c9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:22.027782 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:22.028371 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Emitting event <LifecycleEvent: 1779771967.0269547, 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:22.028617 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] VM Stopped (Lifecycle Event)
May 26 05:06:22.238924 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:22.333225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found WWN 3300000009e4929c1 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:06:22.333225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:22.333225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000009e4929c1', 'path': '/dev/dm-2', 'multipath_id': '3300000009e4929c1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:22.333225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009e4929c1', 'path': '/dev/dm-2', 'multipath_id': '3300000009e4929c1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:06:22.336672 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:22.496334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:22.496994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:22.496994 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attaching volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 to /dev/vdb
May 26 05:06:22.532165 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cc9d417c-b431-40a2-b0e0-d2a1e126bea0 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: 569c7477-611f-4fc2-bbc9-b6ce2a2c92d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:22.555982 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:22.575508 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:22.591080 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:22.632778 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:22.697467 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:22.698078 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:22.713842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:22.715443 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe48:6af6', 'fe80::b4ef:bfff:fe01:45f2', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:06:22.715574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:22.715679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:22.716151 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:22.716487 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating existing volume attachment record: e857bff5-34ab-438b-89de-fde15465c289 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:06:22.842266 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attempting to attach volume 100445b9-af37-4fc5-b5e8-71cc938dab8b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:06:22.847839 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:   <alias name="ua-100445b9-af37-4fc5-b5e8-71cc938dab8b"/>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:   <serial>100445b9-af37-4fc5-b5e8-71cc938dab8b</serial>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:22.847839 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:06:23.293403 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:23.294702 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:23.295907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:23.295907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:23.295907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:23.309326 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:23.309814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:23.309979 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:23.310502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:23.311126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:23.311474 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:23.324962 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:23.324962 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:23.333904 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:23.333904 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:23.341100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:23.353712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.365502 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.365925 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:23.366188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.056s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:23.366693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:23.367176 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('9', '0', '0', 0) found on session 97 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:23.367319 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.377305 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:23.377883 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:23.378705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.068s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:23.378999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:23.379852 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 97 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:23.380153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:23.380866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('10', '0', '0', 0) found on session 98 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:23.381136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:23.391671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 98 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:23.391979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:24.142324 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:24.142949 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:24.142949 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.47 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:24.312163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:06:24.554094 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:24.554542 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:24.555681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:24.555853 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:24.556750 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] No VIF found with MAC fa:16:3e:48:6a:f6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:24.617643 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:24.618163 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:24.618801 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:24.632389 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:25.340032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 33000000098d416b2 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:06:25.340032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:25.341336 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (2045ms) {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:25.341336 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:06:25.344281 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:25.848849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attempting to attach volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:06:25.852298 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:25.852298 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:06:26.144233 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91d5e3dd-c17b-441d-9733-ab93256f5b82 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.563s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:26.226889 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:26.498766 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:26.499189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:26.618223 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:26.618451 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:27.003078 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Detaching volume 100445b9-af37-4fc5-b5e8-71cc938dab8b
May 26 05:06:27.049652 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attempting to driver detach volume 100445b9-af37-4fc5-b5e8-71cc938dab8b from mountpoint /dev/vdc
May 26 05:06:27.061624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found disk vdc by alias ua-100445b9-af37-4fc5-b5e8-71cc938dab8b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:06:27.066033 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found disk vdc by alias ua-100445b9-af37-4fc5-b5e8-71cc938dab8b {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:06:27.066182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Attempting to detach device vdc from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:06:27.066437 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <alias name="ua-100445b9-af37-4fc5-b5e8-71cc938dab8b"/>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <serial>100445b9-af37-4fc5-b5e8-71cc938dab8b</serial>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:27.066437 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:06:27.075342 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully detached device vdc from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the persistent domain config.
May 26 05:06:27.075570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] (1/8): Attempting to detach device vdc with device alias ua-100445b9-af37-4fc5-b5e8-71cc938dab8b from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:06:27.075790 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <alias name="ua-100445b9-af37-4fc5-b5e8-71cc938dab8b"/>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <serial>100445b9-af37-4fc5-b5e8-71cc938dab8b</serial>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:27.075790 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:06:27.242421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:27.557263 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:27.558191 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:27.558959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:27.558959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:44:cc:e2, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:27.564312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:27.617823 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:27.618437 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:27.683307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771987.6828368, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => ua-100445b9-af37-4fc5-b5e8-71cc938dab8b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:06:27.686499 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-100445b9-af37-4fc5-b5e8-71cc938dab8b for instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:06:27.689234 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully detached device vdc from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the live domain config.
May 26 05:06:27.690028 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:27.692393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:06:27.692746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:27.693131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:27.693808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:27.693943 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '100445b9-af37-4fc5-b5e8-71cc938dab8b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:06:27.694254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:27.732667 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [100] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: tcp: [99] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b (non-flash)
May 26 05:06:27.732965 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:27.732965 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', '100'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', '99')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:06:27.733332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', '100')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:27.734012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b', '99')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:27.734880 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46e8860>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:06:27.735094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:06:27.738566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Flush multipath device 3300000009e4929c1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:06:27.781254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:27.829610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:27.870766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:06:27.870766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:06:27.871449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:06:27.887191 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:06:27.887492 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:06:27.902566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:27.944074 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 100, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.40.100,3260]
May 26 05:06:27.944074 np0000001388 nova-compute[98319]: Logout of [sid: 100, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.40.100,3260] successful.
May 26 05:06:27.944074 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:27.967133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:27.981617 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:28.019522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 99, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.50.100,3260]
May 26 05:06:28.019522 np0000001388 nova-compute[98319]: Logout of [sid: 99, target: iqn.2023-03.storpool.com:os--volume-100445b9-af37-4fc5-b5e8-71cc938dab8b, portal: 192.168.50.100,3260] successful.
May 26 05:06:28.019522 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:28.038537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:28.038901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:28.039068 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== disconnect_volume: return (346ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:28.039240 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:06:28.126159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:28.127697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:28.127697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:28.127697 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:06:28.600431 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:29.138137 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c536ae44-e5a5-43c9-bd3a-379653b09b51 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.642s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:29.165636 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.270065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.271954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.371102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.377798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.464768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.465667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.565913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.566373 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:06:29.574759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.621015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a1634e-a86c-4b5f-9be7-887a55884da2 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.121s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:29.686901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.687485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.784551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:29.787397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:29.795190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.799779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:06:29.807091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:29.848239 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:29.914328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:29.914328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.003536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.006486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:30.007519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:30.009415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.096151 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.096687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.211534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.215561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.292103 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:06:30.333284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.334065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.430320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.431675 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:06:30.435966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.526488 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Detaching volume f6ec40b3-38e6-4855-b5e2-8741f6d592e7
May 26 05:06:30.540781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.541225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.597378 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Attempting to driver detach volume f6ec40b3-38e6-4855-b5e2-8741f6d592e7 from mountpoint /dev/vdb
May 26 05:06:30.600656 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found disk vdb by alias ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:06:30.601507 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Found disk vdb by alias ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:06:30.601813 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Attempting to detach device vdb from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:06:30.602013 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <alias name="ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7"/>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <serial>f6ec40b3-38e6-4855-b5e2-8741f6d592e7</serial>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:30.602013 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:06:30.607614 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully detached device vdb from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the persistent domain config.
May 26 05:06:30.607614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] (1/8): Attempting to detach device vdb with device alias ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:06:30.607925 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <alias name="ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7"/>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <serial>f6ec40b3-38e6-4855-b5e2-8741f6d592e7</serial>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:30.607925 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:06:30.629422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 26 05:06:30.636813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.637743 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:06:30.641875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:30.644083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:30.647964 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:30.648710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:30.689235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.040s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:30.689235 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=11611MB free_disk=72.90888977050781GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:06:30.689235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:30.689518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:30.855590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:31.150494 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:06:31.173041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779771991.1726172, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:06:31.173662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 for instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:06:31.180233 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully detached device vdb from instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 from the live domain config.
May 26 05:06:31.181377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:06:31.181728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:31.181883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:31.182417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:31.182722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:06:31.182899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsi session list stdout=tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [95] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [96] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:31.219488 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:31.219882 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '95'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '96'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:06:31.219882 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '96')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:31.221619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7', '95')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:06:31.222618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac437b6a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:06:31.222953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:06:31.223335 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Flush multipath device 330000000c8e054c0 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:06:31.227986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:31.262096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:31.308855 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:06:31.353795 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:06:31.354080 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:06:31.355433 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:06:31.369621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:06:31.369884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:06:31.382034 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.412467 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 96, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.40.100,3260]
May 26 05:06:31.412467 np0000001388 nova-compute[98319]: Logout of [sid: 96, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.40.100,3260] successful.
May 26 05:06:31.412467 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.427275 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.439711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.477129 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 95, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.50.100,3260]
May 26 05:06:31.477129 np0000001388 nova-compute[98319]: Logout of [sid: 95, target: iqn.2023-03.storpool.com:os--volume-f6ec40b3-38e6-4855-b5e2-8741f6d592e7, portal: 192.168.50.100,3260] successful.
May 26 05:06:31.477129 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.495998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:31.496284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:31.496432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] <== disconnect_volume: return (314ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:31.496570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:06:31.705445 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating resource usage from migration a0c74b03-01d5-4e1f-8724-02c0774172f2
May 26 05:06:31.719861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:31.771289 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771385 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771486 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a921deec-f5fe-4c81-a5c2-df30f947a826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771573 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771663 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e44fef6b-6d4c-49b1-977e-3d190c009d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771755 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c6aa2167-8fa0-4795-9166-36d8a29c477a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:31.771844 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7583fee2-acf9-4217-ad23-adca4ec3e186 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:32.049870 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'flavor' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:32.245181 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:32.276228 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance debb889d-e74c-4caa-b278-826a5ed536e0 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 05:06:32.276228 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Migration a0c74b03-01d5-4e1f-8724-02c0774172f2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}}
May 26 05:06:32.276228 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:06:32.556859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:32.557060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:32.566794 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:32.778602 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 258b4ab0-7d70-4714-b0a8-a1827592acad has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 05:06:32.779225 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:06:32.779225 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2048MB phys_disk=95GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:06:30 up 38 min,  2 users,  load average: 7.39, 7.38, 4.39\n', 'num_instances': '8', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '8', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '5', 'io_workload': '1', 'num_proj_9a4d9d2fc50e407ba6bebe55361fcd9a': '1', 'num_task_resize_prep': '1', 'num_proj_c32d47b7a83249e09dab2cfa30367843': '1', 'num_proj_b6925a7d36eb4b919388468635037918': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:06:33.058965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb10fefc-fb68-469b-98f6-0a8efdd3fa52 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.051s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:33.066557 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:33.393312 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:33.394277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:33.394277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:33.394277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:33.394277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:33.399355 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Terminating instance
May 26 05:06:33.412394 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:33.412647 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:33.569740 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Ignoring supplied device name: /dev/vdb
May 26 05:06:33.901999 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:06:33.917897 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:33.923294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:33.939656 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:33.947118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:33.966345 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:33.971156 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.072214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:34.264946 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999664343999939 future=<Future at 0x7d7ac43c5340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:34.265835 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998758436000116 future=<Future at 0x7d7ac43c5340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:34.266010 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998556841000209 future=<Future at 0x7d7ac43c5340 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:34.266259 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Instance destroyed successfully.
May 26 05:06:34.266710 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lazy-loading 'resources' on Instance uuid a2b00aa6-8223-4ad4-8bb6-3776a26ec450 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:34.431689 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:06:34.431930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.743s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:34.432501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.577s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:34.433051 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:34.436662 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:06:34.436713 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Claim successful on node np0000001388
May 26 05:06:34.769662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-765989012',display_name='tempest-TestServerVolumeAttachmentScenario-server-765989012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testservervolumeattachmentscenario-server-765989012',id=34,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHXAMq5mBl39p3skYN03GmF869tjBmVUzoWg+Dkayt6IIoBVKptng0Wr+TtSrh8IGzi1oXbJo92rls+gYvBbXD8CzmdSw66xottZYKCzysulA4J2gJGFibkd7PErr4FAdg==',key_name='tempest-keypair-100102815',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:25Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9a4d9d2fc50e407ba6bebe55361fcd9a',ramdisk_id='',reservation_id='r-hzgnwlm7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-952799259',owner_user_name='tempest-TestServerVolumeAttachmentScenario-952799259-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:05:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bea66e2b64da4ac5ac8a73b1a96729b3',uuid=a2b00aa6-8223-4ad4-8bb6-3776a26ec450,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:06:34.770035 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converting VIF {"id": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "address": "fa:16:3e:48:6a:f6", "network": {"id": "066709c7-2959-4cbd-a826-efea45520917", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-677854693-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "9a4d9d2fc50e407ba6bebe55361fcd9a", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c7d8b0-5e", "ovs_interfaceid": "60c7d8b0-5ee7-4760-9189-072a3cc3f6b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:34.770940 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:34.771338 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:06:34.774751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.774751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c7d8b0-5e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:34.774751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.775039 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:34.775283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.777038 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.777227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2165212-ffe0-465c-bdd4-841a18100eb4) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:34.777800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.778428 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:34.779009 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:34.782008 np0000001388 nova-compute[98319]: INFO os_vif [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:6a:f6,bridge_name='br-int',has_traffic_filtering=True,id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9,network=Network(066709c7-2959-4cbd-a826-efea45520917),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c7d8b0-5e')
May 26 05:06:34.782494 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Deleting instance files /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450_del
May 26 05:06:34.783502 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Deletion of /opt/stack/data/nova/instances/a2b00aa6-8223-4ad4-8bb6-3776a26ec450_del complete
May 26 05:06:35.180047 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:35.180605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:35.180605 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Attaching volume 52adf80f-a9b8-4438-9dbe-b3217131fbb4 to /dev/vdb
May 26 05:06:35.224544 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:35.233922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:35.253135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:35.290402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:35.290625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:35.291432 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Took 1.39 seconds to destroy the instance on the hypervisor.
May 26 05:06:35.294734 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:06:35.294991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:06:35.295087 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:06:35.295461 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:35.300488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:35.301868 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:06:35.302013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:35.302127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:35.302376 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:35.302562 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating existing volume attachment record: 052410df-5220-4835-bd50-486b68ecc256 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:06:35.359183 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:35.432682 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:06:35.432855 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:06:35.433136 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.07 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:06:35.854467 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:35.854962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:35.855144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:35.855940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:35.857332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:35.863040 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5877518e-3dd8-44e9-b1aa-1f86940644dc req-160a7019-7e4a-4725-a4e3-8844bddcbe79 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Received event network-vif-deleted-60c7d8b0-5ee7-4760-9189-072a3cc3f6b9 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:35.863040 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5877518e-3dd8-44e9-b1aa-1f86940644dc req-160a7019-7e4a-4725-a4e3-8844bddcbe79 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Neutron deleted interface 60c7d8b0-5ee7-4760-9189-072a3cc3f6b9; detaching it from the instance and deleting it from the info cache
May 26 05:06:35.863040 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5877518e-3dd8-44e9-b1aa-1f86940644dc req-160a7019-7e4a-4725-a4e3-8844bddcbe79 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:35.870071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:35.871472 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:35.876185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:35.876463 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:35.877117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:35.877578 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:35.887601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:35.887601 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:35.894768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:06:35.894768 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:35.902295 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4] added
May 26 05:06:35.902295 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:35.902295 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:35.902295 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:35.902295 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:35.902295 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:35.902295 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:35.902636 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:35.902722 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0262(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:35.902917 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:35.907695 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4] added
May 26 05:06:35.907695 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:06:35.907695 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:35.907695 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:35.907695 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:06:35.907695 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:06:35.907695 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:35.907977 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:06:35.907977 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0305(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:06:35.908101 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:06:36.139511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:36.140283 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:36.304662 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:36.368992 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5877518e-3dd8-44e9-b1aa-1f86940644dc req-160a7019-7e4a-4725-a4e3-8844bddcbe79 service nova] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Detach interface failed, port_id=60c7d8b0-5ee7-4760-9189-072a3cc3f6b9, reason: Instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:06:36.645123 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:36.807708 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Took 1.51 seconds to deallocate network for instance.
May 26 05:06:36.903370 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:36.908513 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:36.921228 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:36.921228 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:36.929106 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:36.929106 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:36.937079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:36.941339 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.950628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:36.961288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:36.961288 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.961288 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.961288 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.961288 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.961288 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:36.961513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:36.961513 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.961513 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:36.961513 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.961513 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:36.961513 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:37.005776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.50.100,3260]
May 26 05:06:37.005776 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.50.100,3260] successful.
May 26 05:06:37.005776 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:37.014622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.40.100,3260]
May 26 05:06:37.014622 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.40.100,3260] successful.
May 26 05:06:37.014622 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:37.020894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:37.026831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.043913 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.044293 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:37.044537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:37.044656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:37.045552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] HCTL ('11', '-', '-', 0) found on session 103 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:37.045685 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:37.068664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching for a device in session 103 and hctl ['11', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [101] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6e8b7cdf-0848-4574-a768-cc3a9aa14026 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:37.074403 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.197s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:37.074403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:37.075721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] HCTL ('8', '-', '-', 0) found on session 102 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:37.076004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:37.097051 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching for a device in session 102 and hctl ['8', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:37.097051 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:37.153206 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.721s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:37.158617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 5.928s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:37.158617 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:06:37.248607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:37.314994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:37.671792 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:06:37.672009 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:06:37.672215 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:37.672472 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:37.679634 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:06:37.679953 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Claim successful on node np0000001388
May 26 05:06:37.766141 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0799194be46487e89960ac774578992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b22c1abf2f4ba788005f454c7f8add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:06:38.067973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Searching for a device in session 103 and hctl ['11', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:38.068172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:38.181998 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:06:38.190305 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating resource usage from migration a0c74b03-01d5-4e1f-8724-02c0774172f2
May 26 05:06:38.288224 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Successfully created port: 96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:06:38.686024 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:06:38.844377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:38.844659 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:38.887828 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Successfully updated port: 96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:06:38.896945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found WWN 330000000489b974b for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:06:38.898832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:38.898832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== connect_volume: return (3043ms) {'type': 'block', 'scsi_wwn': '330000000489b974b', 'path': '/dev/dm-0', 'multipath_id': '330000000489b974b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:38.898832 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000489b974b', 'path': '/dev/dm-0', 'multipath_id': '330000000489b974b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:06:38.901193 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:38.962650 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-changed-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:38.962896 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Refreshing instance network info cache due to event network-changed-96479187-86e9-4e4d-b112-d286c23de3d7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:38.963143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] Acquiring lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:38.963373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] Acquired lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:38.964573 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Refreshing network info cache for port 96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:39.348178 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:39.389714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:39.412954 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Attempting to attach volume 52adf80f-a9b8-4438-9dbe-b3217131fbb4 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:06:39.414160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:   <alias name="ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4"/>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:   <serial>52adf80f-a9b8-4438-9dbe-b3217131fbb4</serial>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]: </disk>
May 26 05:06:39.414160 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:06:39.468040 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:39.543502 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:06:39.676948 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:39.695219 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:06:39.696085 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:06:39.696243 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Creating image(s)
May 26 05:06:39.696657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:39.696807 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:39.697594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:39.698065 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:39.700958 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:39.701863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:39.779067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:39.791593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:39.792921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:39.793818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:39.794448 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:39.798855 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:39.799290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:39.856180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.702s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:39.856918 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Migrating
May 26 05:06:39.857311 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:06:39.862055 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 8.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:39.885627 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:06:39.885627 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Claim successful on node np0000001388
May 26 05:06:39.899290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:39.899739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:39.969354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk 1073741824" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:39.969985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:39.970326 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:40.083648 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:40.084401 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:06:40.084697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:40.179429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2c30166-b5b7-484d-8996-dd7304ac5a72 req-491f4965-3d53-4863-a3be-b0ec127db23c service nova] Releasing lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Cannot resize image /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Ensure instance console log exists: /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:40.184334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:40.391430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:40.391788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:40.391922 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:40.771734 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:06:40.895833 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:40.977355 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:41.088674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:41.089510 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:41.089882 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:41.090069 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] No VIF found with MAC fa:16:3e:4e:41:af, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:41.220730 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:41.328923 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:41.521455 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:41.645941 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:41.646191 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:41.723599 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:41.724034 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance network_info: |[{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:06:41.725995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start _get_guest_xml network_info=[{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:06:41.728190 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:41.729550 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1279744446', uuid='debb889d-e74c-4caa-b278-826a5ed536e0'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772001.7291293) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:06:41.731014 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:06:41.731437 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:06:41.732316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:06:41.732510 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:06:41.733426 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:06:41.733817 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:06:41.734008 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:06:41.734131 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:06:41.734507 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:06:41.734580 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:06:41.734663 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:06:41.734881 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:06:41.734989 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:06:41.735092 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:06:41.735191 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:06:41.735330 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:06:41.749260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279744446',display_name='tempest-ServerRescueNegativeTestJSON-server-1279744446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-1279744446',id=40,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-lxe4ad61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:39Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=debb889d-e74c-4caa-b278-826a5ed536e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:06:41.749511 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:41.750054 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:41.750707 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:42.023714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:42.149800 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:42.269079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.270615 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <uuid>debb889d-e74c-4caa-b278-826a5ed536e0</uuid>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <name>instance-00000028</name>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1279744446</nova:name>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:06:41</nova:creationTime>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         <nova:port uuid="96479187-86e9-4e4d-b112-d286c23de3d7">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <system>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="serial">debb889d-e74c-4caa-b278-826a5ed536e0</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="uuid">debb889d-e74c-4caa-b278-826a5ed536e0</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </system>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <os>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </os>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <features>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </features>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   <devices>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:9d:0f:6c"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <target dev="tap96479187-86"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </interface>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/console.log" append="off"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </serial>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <video>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </video>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </rng>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:   </devices>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]: </domain>
May 26 05:06:42.270615 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Preparing to wait for external event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279744446',display_name='tempest-ServerRescueNegativeTestJSON-server-1279744446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-1279744446',id=40,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-lxe4ad61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:39Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=debb889d-e74c-4caa-b278-826a5ed536e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:06:42.273453 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:42.273866 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:42.274017 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:06:42.275047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.275047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:42.275184 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:06:42.276222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.276441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9941413-ea84-5ef3-9ed2-fb95e6c1325c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:42.277116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.278176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:42.280110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.283150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.283329 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96479187-86, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:42.283631 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96479187-86, col_values=(('qos', UUID('5f912e5d-5375-49b8-80c4-37a0e49f979b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:42.283828 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96479187-86, col_values=(('external_ids', {'iface-id': '96479187-86e9-4e4d-b112-d286c23de3d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9d:0f:6c', 'vm-uuid': 'debb889d-e74c-4caa-b278-826a5ed536e0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:42.284541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.285846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:42.291905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:42.292699 np0000001388 nova-compute[98319]: INFO os_vif [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86')
May 26 05:06:42.651511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6d66c1c4-0108-4ae4-bf86-2dc407aa52e8 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.471s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:42.657942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.796s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:42.658555 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:06:42.661240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 5.344s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:43.132824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:43.133335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:43.133335 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Shelving
May 26 05:06:43.165269 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:06:43.168233 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:06:43.168233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:43.168233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:43.288227 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0799194be46487e89960ac774578992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b22c1abf2f4ba788005f454c7f8add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:06:43.322662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:43.322974 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:43.538974 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 26 05:06:43.573668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.597107 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.624157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.666872 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:06:43.748982 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:43.749797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:43.750321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:43.750804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:43.751634 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:43.751868 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b315678a-6391-4d05-b717-774af703ee6a req-e768d1f1-e537-461f-8ffe-139850fc4b15 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received unexpected event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with vm_state active and task_state resize_migrating.
May 26 05:06:43.774736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.789560 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.812941 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:43.813125 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:43.813440 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:9d:0f:6c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:43.814136 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Using config drive
May 26 05:06:43.826739 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:43.898876 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999607219000154 future=<Future at 0x7d7aa427acc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:43.902177 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance destroyed successfully.
May 26 05:06:43.906927 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Successfully created port: 864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:06:43.909797 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:47Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:06:43.909797 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:43.910722 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:43.911360 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:06:43.913523 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.914501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f7ac1e-f1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:43.915659 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.916663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:43.923100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.923967 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.924962 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3087f7b-b656-4644-b53d-c7d53cca40b8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:43.926321 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.927703 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:43.934266 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:43.936668 np0000001388 nova-compute[98319]: INFO os_vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1')
May 26 05:06:44.170925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:06:44.173089 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:44.201392 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:44.202866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:44.227161 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:44.236996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:44.325034 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:44.339235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.679s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:44.401231 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Deleted allocations for instance a2b00aa6-8223-4ad4-8bb6-3776a26ec450
May 26 05:06:44.448463 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:44.448463 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:44.448847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:44.448847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:44.448957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:44.449158 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-96347dc8-a0ca-4196-b1fe-b39a27af5f1c req-de089746-359b-457c-a76a-15256b5acb5b service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received unexpected event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with vm_state active and task_state shelving.
May 26 05:06:44.491972 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Detected multiple connections on this host for volume: 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, skipping target disconnect.
May 26 05:06:44.495187 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999618188000113 future=<Future at 0x7d7ac46f34d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:44.499445 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance destroyed successfully.
May 26 05:06:44.500574 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'numa_topology' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:44.507768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.531048 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Creating config drive at /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config
May 26 05:06:44.543375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppezb5eys {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.618226 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmppezb5eys" returned: 0 in 0.074s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:44.632002 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:44.635542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.747508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:44.747658 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:06:44.748271 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.851112 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Successfully updated port: 864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:06:44.862802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:44.863164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk.config /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.910698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk.config /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:44.911129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk.info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:44.963085 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_resize/disk.info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.078484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.119103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.126156 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Beginning cold snapshot process
May 26 05:06:45.189123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:06:45.195818 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:06:45.197934 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Creating image(s)
May 26 05:06:45.197934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:45.197934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:45.197934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:45.201081 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:45.207106 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:45.212441 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:45.226441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.315961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.317545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:45.318358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:45.318479 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:45.321146 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:45.321528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:45.356044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:45.356631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:45.356631 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:45.415504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.416049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:45.438610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65e4669b-4f2d-4459-a512-1f43c2d5bcc3 tempest-TestServerVolumeAttachmentScenario-952799259 tempest-TestServerVolumeAttachmentScenario-952799259-project-member] Lock "a2b00aa6-8223-4ad4-8bb6-3776a26ec450" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.044s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:45.478320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk 1073741824" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.478525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:45.478963 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:45.518563 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.526929 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.529848 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.556232 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.563434 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:45.568897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.569568 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:06:45.569849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:45.681586 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:45.683457 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Cannot resize image /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:06:45.683845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:06:45.684042 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Ensure instance console log exists: /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:06:45.684353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:45.685618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:45.685618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:45.821373 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:45.821765 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:45.822474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:45.822722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:45.823131 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:45.823415 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d1c6f5fc-0702-40f3-88b8-ddb9cfca3a49 req-d411cff6-d29a-41c5-aded-2a39c74793d5 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received unexpected event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with vm_state active and task_state resize_migrating.
May 26 05:06:45.922655 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:06:45.957082 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772005.9567149, debb889d-e74c-4caa-b278-826a5ed536e0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:45.957254 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Started (Lifecycle Event)
May 26 05:06:46.094996 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:46.099812 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:46.100030 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:46.203916 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Port f0f7ac1e-f1fb-4712-80af-906a91796719 binding to destination host np0000001388 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 26 05:06:46.257222 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updating instance_info_cache with network_info: [{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:46.461805 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:46.465231 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772006.4640296, debb889d-e74c-4caa-b278-826a5ed536e0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:46.465231 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Paused (Lifecycle Event)
May 26 05:06:46.556653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received unexpected event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with vm_state active and task_state shelving_image_pending_upload.
May 26 05:06:46.558897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-changed-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:46.560985 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Refreshing instance network info cache due to event network-changed-864a6c86-884c-476f-986c-54dbab598b27. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:46.562362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Acquiring lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:46.642930 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:06:46.643888 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk /opt/stack/data/nova/instances/snapshots/tmpmry3nxpl/59bc2be9ee37410c920d9673b669876e {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:46.760543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:46.761057 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance network_info: |[{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:06:46.764113 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Acquired lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:46.764113 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start _get_guest_xml network_info=[{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:06:46.764708 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Refreshing network info cache for port 864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:46.767474 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:46.769454 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-793598710', uuid='258b4ab0-7d70-4714-b0a8-a1827592acad'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772006.7686179) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:06:46.772028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:06:46.772135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:06:46.773604 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:06:46.773671 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:06:46.777462 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:06:46.778555 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:06:46.778555 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:06:46.794954 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-793598710',display_name='tempest-ServerRescueNegativeTestJSON-server-793598710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-793598710',id=41,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-kuru2plv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:44Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=258b4ab0-7d70-4714-b0a8-a1827592acad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:06:46.795255 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:46.795898 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:46.797970 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:46.955559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk /opt/stack/data/nova/instances/snapshots/tmpmry3nxpl/59bc2be9ee37410c920d9673b669876e" returned: 0 in 0.312s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:46.955922 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Snapshot extracted, beginning image upload
May 26 05:06:46.969405 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:46.972038 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:47.219220 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:06:47.230348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:47.230454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:47.230683 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:47.269370 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.271033 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:47.301631 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] End _get_guest_xml xml=<domain type="qemu">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <uuid>258b4ab0-7d70-4714-b0a8-a1827592acad</uuid>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <name>instance-00000029</name>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-793598710</nova:name>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:06:46</nova:creationTime>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         <nova:port uuid="864a6c86-884c-476f-986c-54dbab598b27">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <system>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="serial">258b4ab0-7d70-4714-b0a8-a1827592acad</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="uuid">258b4ab0-7d70-4714-b0a8-a1827592acad</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </system>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <os>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </os>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <features>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </features>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   <devices>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </disk>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:de:bf:10"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <target dev="tap864a6c86-88"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </interface>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/console.log" append="off"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </serial>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <video>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </video>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </rng>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:   </devices>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]: </domain>
May 26 05:06:47.301631 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:06:47.303532 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Preparing to wait for external event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:06:47.303532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:47.303532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:47.303532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:47.303532 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-793598710',display_name='tempest-ServerRescueNegativeTestJSON-server-793598710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-793598710',id=41,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-kuru2plv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:44Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=258b4ab0-7d70-4714-b0a8-a1827592acad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:06:47.303851 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:47.304166 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:47.304484 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:06:47.305328 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.305573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:47.305847 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:06:47.310927 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.311142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e0b1c37-82a2-54eb-98b2-7b88a5d0a9c4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:47.312579 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.313440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:47.318529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.322843 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.323021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap864a6c86-88, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:47.323420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap864a6c86-88, col_values=(('qos', UUID('b7d051ff-8e43-4ed1-806b-ad32b98e3b01')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:47.323610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap864a6c86-88, col_values=(('external_ids', {'iface-id': '864a6c86-884c-476f-986c-54dbab598b27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:bf:10', 'vm-uuid': '258b4ab0-7d70-4714-b0a8-a1827592acad'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:47.326384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:47.334169 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:47.335317 np0000001388 nova-compute[98319]: INFO os_vif [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88')
May 26 05:06:47.475220 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:47.611561 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:47.801229 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updated VIF entry in instance network info cache for port 864a6c86-884c-476f-986c-54dbab598b27. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:06:47.801512 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updating instance_info_cache with network_info: [{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:48.244507 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:48.305788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:48.305788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:48.305996 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:48.307275 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Releasing lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:48.307535 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:48.307747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:48.307933 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:48.308065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:48.308213 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Processing event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:06:48.308435 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:48.308617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:48.308813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:48.308969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:48.309110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:48.309705 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:06:48.309936 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-71546e2c-26ed-4622-8517-747ff1d17e78 req-ff00483e-7174-4e9a-a094-d00147537e94 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state building and task_state spawning.
May 26 05:06:48.312594 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772008.3121626, debb889d-e74c-4caa-b278-826a5ed536e0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:48.312847 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Resumed (Lifecycle Event)
May 26 05:06:48.314120 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:06:48.317074 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance spawned successfully.
May 26 05:06:48.317398 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:06:48.810321 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:48.817268 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:48.819743 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:48.829576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.829726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.830146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.830472 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.830810 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.831473 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:48.869241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:48.869241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:06:48.869241 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:de:bf:10, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:06:48.872136 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Using config drive
May 26 05:06:49.203213 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:49.265578 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0009878659998321382 future=<Future at 0x7d7ac43c5340 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:49.266071 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:49.266071 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.632619862999945 future=<Future at 0x7d7aa427acc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:49.266071 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.632532691000051 future=<Future at 0x7d7aa427acc0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:49.267656 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Emitting event <LifecycleEvent: 1779771994.2644906, a2b00aa6-8223-4ad4-8bb6-3776a26ec450 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:49.267656 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] VM Stopped (Lifecycle Event)
May 26 05:06:49.325674 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:49.343289 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Took 9.65 seconds to spawn the instance on the hypervisor.
May 26 05:06:49.343436 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:49.380098 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:49.416737 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:49.552838 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Creating config drive at /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config
May 26 05:06:49.556708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk49biaye {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:49.643228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpk49biaye" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:49.773748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: a2b00aa6-8223-4ad4-8bb6-3776a26ec450] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:49.866397 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Took 19.07 seconds to build instance.
May 26 05:06:49.926216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:49.933515 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Snapshot image upload complete
May 26 05:06:49.933844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:50.152174 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.183650 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.188737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.293070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.351501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.358230 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.373072 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.586s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:50.428714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-584f9abb-7838-426d-b7e8-581b1b05fb88 req-0e301622-4a33-4291-be19-d99a0c0c4f15 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:50.429060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-584f9abb-7838-426d-b7e8-581b1b05fb88 req-0e301622-4a33-4291-be19-d99a0c0c4f15 service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:50.429417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-584f9abb-7838-426d-b7e8-581b1b05fb88 req-0e301622-4a33-4291-be19-d99a0c0c4f15 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:50.429633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-584f9abb-7838-426d-b7e8-581b1b05fb88 req-0e301622-4a33-4291-be19-d99a0c0c4f15 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:50.429945 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-584f9abb-7838-426d-b7e8-581b1b05fb88 req-0e301622-4a33-4291-be19-d99a0c0c4f15 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Processing event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:06:50.441305 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:50.455438 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Shelve offloading
May 26 05:06:50.460641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:06:50.503701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:50.580663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:06:50.580663 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:06:50.593121 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:06:50.598178 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::fc16:3eff:fe4e:41af', 'fe80::9c6d:99ff:fe60:5d00', 'fe80::fc16:3eff:fe44:cce2', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fede:bf10'] 
May 26 05:06:50.599900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:06:50.599900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:06:50.599900 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:06:50.618058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:50.974523 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance destroyed successfully.
May 26 05:06:50.978018 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:50.980056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:50.980523 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:50.980523 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:51.126148 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772011.1256268, 258b4ab0-7d70-4714-b0a8-a1827592acad => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:51.126267 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Started (Lifecycle Event)
May 26 05:06:51.128164 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:06:51.131988 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:06:51.136303 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance spawned successfully.
May 26 05:06:51.137390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:06:51.486158 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:51.631254 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:51.633644 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:51.644723 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.644890 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.645265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.645556 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.645861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.646141 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:06:51.793268 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 26 05:06:51.794728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:06:51.795033 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Creating image(s)
May 26 05:06:51.800220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:51.923996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:51.923996 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:06:51.923996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:51.953674 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:52.042808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:52.043679 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:06:52.119547 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:52.134885 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:06:52.136984 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772012.136662, 258b4ab0-7d70-4714-b0a8-a1827592acad => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:52.138066 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Paused (Lifecycle Event)
May 26 05:06:52.155796 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Took 6.97 seconds to spawn the instance on the hypervisor.
May 26 05:06:52.156010 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:52.271148 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:52.326315 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:52.545907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:06:52.546326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Ensure instance console log exists: /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:06:52.546672 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:52.546939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:52.547093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:52.549793 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start _get_guest_xml network_info=[{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'e981536b-bdc7-4791-9521-8ab881735821', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '67e6c789-cd47-4a9d-85a4-3c51faa4d646', 'attached_at': '2026-05-26T05:06:51.000000', 'detached_at': '', 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'multiattach': True, 'serial': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:06:52.552356 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:52.552885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:52.553058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:52.553186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:52.553483 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:52.556221 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-080256d0-1f3a-493a-86cb-b3df6e8657c4 req-8c5622fd-7ec7-4fb6-85b9-8200e32ce905 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received unexpected event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with vm_state active and task_state None.
May 26 05:06:52.556882 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:52.558107 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='67e6c789-cd47-4a9d-85a4-3c51faa4d646'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772012.5577035) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:06:52.559772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:06:52.560225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:06:52.562935 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:06:52.563453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:06:52.564940 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:06:52.565458 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:06:52.567099 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:06:52.567360 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:06:52.567793 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:06:52.567793 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:06:52.568012 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:06:52.568071 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:06:52.568235 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:06:52.570314 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:06:52.570466 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:06:52.570598 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:06:52.593107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:52.623151 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:52.624971 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:52.624971 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:52.644774 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:52.658347 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772012.6578565, 258b4ab0-7d70-4714-b0a8-a1827592acad => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:52.658659 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Resumed (Lifecycle Event)
May 26 05:06:52.677669 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Took 21.02 seconds to build instance.
May 26 05:06:52.727272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config --force-share --output=json" returned: 0 in 0.134s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:52.728370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:52.728370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:52.728849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:52.729341 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:06:52.729830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:06:52.731082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:52.731082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:52.731082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:06:52.746496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:52.746940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:52.747537 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:06:52.748877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:06:52.750147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:06:52.750147 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:52.761076 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:52.761076 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:06:52.769527 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:06:52.769527 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:52.780110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:52.785800 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e45bdbf9-91fd-44f4-85ad-1723b4349a0a (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.804955 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e45bdbf9-91fd-44f4-85ad-1723b4349a0a (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.806083 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:52.806083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:52.806470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('9', '0', '0', 0) found on session 97 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:52.806470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:52.813488 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e45bdbf9-91fd-44f4-85ad-1723b4349a0a (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.815614 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [104] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e45bdbf9-91fd-44f4-85ad-1723b4349a0a (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:06:52.815893 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:06:52.816244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.067s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:06:52.816244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:06:52.818251 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('10', '0', '0', 0) found on session 98 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:06:52.818722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:06:52.820069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 97 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:52.820304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:52.832876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 98 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:06:52.833177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:06:53.162897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:53.167057 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:53.181365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1e8cd84-22aa-4b57-a9b0-b8b3c29b8cf8 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.537s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:53.233871 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance destroyed successfully.
May 26 05:06:53.236118 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'resources' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:53.334726 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:53.334932 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing instance network info cache due to event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:06:53.335679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:53.335818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:53.336311 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:06:53.467424 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Rescuing
May 26 05:06:53.468107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:06:53.468255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:06:53.468637 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:06:53.671078 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] During sync_power_state the instance has a pending task (rescuing). Skip.
May 26 05:06:53.743738 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:06:53.744846 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPMxUQzoIudUsr7giSdmJtCmDmteNUA+Fv8w2zZXDygF4TeUGoF39pC/VETxTJVPT7Gg8Oa6aT9Z2V0kbJ9zZ3bKJ43KEBJKqg11cEMim1aeTo+q5MNnl8M0B2/qddPig==',key_name='tempest-keypair-1986219734',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:01Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:06:49.933563',shelved_host='np0000001388',shelved_image_id='cfdda07c-8fc3-4597-8631-a058ccd52d92'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:06:53.745410 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:53.747793 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:53.748351 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:06:53.756870 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:53.757285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0504e6f4-65, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:53.758903 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:06:53.759093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:53.760140 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:53.763152 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:53.764565 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:53.765032 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=189f1fd6-622f-4899-b69c-0eb9f7687fa1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:06:53.767572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:53.768519 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:06:53.771879 np0000001388 nova-compute[98319]: INFO os_vif [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65')
May 26 05:06:53.772241 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Deleting instance files /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a_del
May 26 05:06:53.780234 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Deletion of /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a_del complete
May 26 05:06:53.839133 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:53.971449 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:54.320543 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:54.377006 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Deleted allocations for instance c6aa2167-8fa0-4795-9166-36d8a29c477a
May 26 05:06:54.423051 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:06:54.579056 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updated VIF entry in instance network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:06:54.580187 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap0504e6f4-65", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:54.637710 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updating instance_info_cache with network_info: [{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:06:54.885472 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:54.885993 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:55.086740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-eedf7165-b05c-44ec-ae3e-567c4d828884 req-58e7cd83-a21a-486b-890b-934ce9a5143a service nova] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:55.139938 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-258b4ab0-7d70-4714-b0a8-a1827592acad" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:06:55.449526 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:06:55.449827 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:06:55.953257 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:06:56.460830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.573s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:56.778731 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:56.780026 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:56.814149 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:56.979502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f2a8ea8e-e63b-455c-9c78-b32628ea0591 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 13.845s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:56.999807 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:57.006271 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:57.091540 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999687267000354 future=<Future at 0x7d7aa4431670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:57.093477 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance destroyed successfully.
May 26 05:06:57.093950 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'numa_topology' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:57.268042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:57.268277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:57.268509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:57.268589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:57.268744 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:57.268884 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-fa6e8fea-b600-4a71-a487-fd3196f939c7 req-c8827198-f6ef-4ade-a172-0bdf5ab41e4b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received unexpected event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with vm_state active and task_state rescuing.
May 26 05:06:57.601238 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Attempting rescue
May 26 05:06:57.601238 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 05:06:57.605142 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:06:57.605327 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Creating image(s)
May 26 05:06:57.606061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:57.606280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:57.606812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:57.606993 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'trusted_certs' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:58.010147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:58.010565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:58.110596 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:06:58.111507 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:58.115893 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:58.116964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:58.117380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:58.117754 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:58.121895 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:06:58.122229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:58.229794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:58.230261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:06:58.288175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:06:58.289531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.172s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:58.289973 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'migration_context' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:58.513545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:06:58.767403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:06:58.792706 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:06:58.793068 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:06:58.793659 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start _get_guest_xml network_info=[{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:de:bf:10"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:06:58.793883 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:58.900804 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0023269540001820133 future=<Future at 0x7d7aa427acc0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:58.901378 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772003.8983107, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:58.901558 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:58.901776 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Stopped (Lifecycle Event)
May 26 05:06:58.903021 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.5918860340002539 future=<Future at 0x7d7ac46f34d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:58.903334 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.5915079490000608 future=<Future at 0x7d7ac46f34d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:58.946939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:58.947216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:58.947382 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Unshelving
May 26 05:06:59.065454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:59.065922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:59.069130 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:06:59.069268 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Claim successful on node np0000001388
May 26 05:06:59.298642 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:06:59.302179 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:06:59.303745 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-793598710', uuid='258b4ab0-7d70-4714-b0a8-a1827592acad'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:de:bf:10"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772019.3032882) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:06:59.308561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:06:59.308888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:06:59.309708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:06:59.309894 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:06:59.310844 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:06:59.311302 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:06:59.311533 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:06:59.311678 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:06:59.311894 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:06:59.312029 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:06:59.312191 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:06:59.312429 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:06:59.312578 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:06:59.312736 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:06:59.312855 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:06:59.313042 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:06:59.315927 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'vcpu_model' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:59.341943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:06:59.342112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:06:59.342300 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:06:59.342426 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:06:59.342574 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:06:59.342698 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-92e9748c-73a9-4fcd-9226-4131f1810772 req-fa617bf8-58ed-4f80-b746-eece57bfb244 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received unexpected event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with vm_state active and task_state rescuing.
May 26 05:06:59.404792 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:06:59.406460 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:06:59.495367 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003385189997970883 future=<Future at 0x7d7ac46f34d0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:59.497919 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:59.497919 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.595154624000315 future=<Future at 0x7d7aa4431670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:59.497919 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.595049698000366 future=<Future at 0x7d7aa4431670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:06:59.497919 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Emitting event <LifecycleEvent: 1779772004.49473, c6aa2167-8fa0-4795-9166-36d8a29c477a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:06:59.497919 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Stopped (Lifecycle Event)
May 26 05:06:59.819598 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:06:59.829939 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-793598710',display_name='tempest-ServerRescueNegativeTestJSON-server-793598710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-793598710',id=41,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:52Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-kuru2plv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:52Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=258b4ab0-7d70-4714-b0a8-a1827592acad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:de:bf:10"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:06:59.830109 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:de:bf:10"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:06:59.830686 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:06:59.831291 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:06:59.908556 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6a73ea31-f267-4355-914b-8f33214ff012 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 26 05:06:59.999910 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:00.006853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:00.333295 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:00.334615 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <uuid>258b4ab0-7d70-4714-b0a8-a1827592acad</uuid>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <name>instance-00000029</name>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-793598710</nova:name>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:06:59</nova:creationTime>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         <nova:port uuid="864a6c86-884c-476f-986c-54dbab598b27">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="serial">258b4ab0-7d70-4714-b0a8-a1827592acad</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="uuid">258b4ab0-7d70-4714-b0a8-a1827592acad</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config.rescue"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:de:bf:10"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <target dev="tap864a6c86-88"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/console.log" append="off"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:00.334615 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:00.338900 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance destroyed successfully.
May 26 05:07:00.596218 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:00.596429 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:00.799067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 33000000098d416b2 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:07:00.799465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.069s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:00.799905 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (8070ms) {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:00.800053 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:07:01.098953 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:01.306256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:47Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:01.306552 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:01.307149 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:01.308454 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <uuid>67e6c789-cd47-4a9d-85a4-3c51faa4d646</uuid>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <name>instance-00000024</name>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <memory>262144</memory>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-0</nova:name>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:06:52</nova:creationTime>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         <nova:port uuid="f0f7ac1e-f1fb-4712-80af-906a91796719">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="serial">67e6c789-cd47-4a9d-85a4-3c51faa4d646</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="uuid">67e6c789-cd47-4a9d-85a4-3c51faa4d646</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk.config"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <shareable/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:34:86:0d"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <target dev="tapf0f7ac1e-f1"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/console.log" append="off"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:01.308454 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:47Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:34:86:0d"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:01.311613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:07:01.312213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.312383 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '627a761e-f6c0-5fe3-9914-4f846acc6ced', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:01.313176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.314020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:01.320999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.323973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.324189 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0f7ac1e-f1, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:01.324568 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0f7ac1e-f1, col_values=(('qos', UUID('68a53d4b-02df-4030-b527-42092d15f31e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:01.324744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0f7ac1e-f1, col_values=(('external_ids', {'iface-id': 'f0f7ac1e-f1fb-4712-80af-906a91796719', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:86:0d', 'vm-uuid': '67e6c789-cd47-4a9d-85a4-3c51faa4d646'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:01.325572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.326708 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:01.336287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:01.337305 np0000001388 nova-compute[98319]: INFO os_vif [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1')
May 26 05:07:01.605537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.540s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:01.606344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.599s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:01.606596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:07:01.611563 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_requests' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:01.853672 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:01.853672 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:01.853672 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:01.853946 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:de:bf:10, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:01.855070 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Using config drive
May 26 05:07:02.117474 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'numa_topology' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:02.119570 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:07:02.119570 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:07:02.119936 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:02.120374 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:02.194421 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5c64df40bd44d89d8f1617f4fa5281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0c90d3ca84a4bb5aaf3f1c8245e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:07:02.274543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:02.356627 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'ec2_ids' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:02.631378 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:07:02.631378 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Claim successful on node np0000001388
May 26 05:07:02.634920 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:07:02.746892 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Successfully created port: bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:07:02.858305 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:02.858534 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:02.858534 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:02.858675 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:34:86:0d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:02.859168 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Using config drive
May 26 05:07:02.859961 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:02.860335 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'keypairs' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:03.140518 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:07:03.343872 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.364055 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<258b4ab0-7d70-4714-b0a8-a1827592acad> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:03.366985 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:03.386820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.389079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.432090 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Successfully updated port: bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:07:03.466654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.504398 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-changed-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:03.504581 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Refreshing instance network info cache due to event network-changed-bfad2e7c-9ae2-4ec7-976d-90faac916b69. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:03.507292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] Acquiring lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:03.508240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] Acquired lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:03.508516 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Refreshing network info cache for port bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:03.567028 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Creating config drive at /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config.rescue
May 26 05:07:03.567540 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.571860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm023d04 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:03.589614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:03.622314 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:03.622314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:03.622314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:03.622314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:03.622580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:03.622651 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8b93a423-a36a-46a9-aca0-03ca74a9f81d req-1183c3fd-9582-45c7-a1fe-e3efbc100b85 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received unexpected event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with vm_state active and task_state resize_finish.
May 26 05:07:03.651940 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqm023d04" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:03.936333 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:04.013478 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:04.112008 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:07:04.153383 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:07:04.154469 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:07:04.154701 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Creating image(s)
May 26 05:07:04.155155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:04.155473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:04.156159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:04.158580 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:04.162453 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:04.167438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:04.190331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.206709 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.206709 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.299313 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.302028 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:04.304400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:04.305125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:04.307101 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:04.309257 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:04.309884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:04.361700 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:04.392173 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.397442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:04.409457 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772024.4062526, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:04.409579 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Resumed (Lifecycle Event)
May 26 05:07:04.415861 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:07:04.421630 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance running successfully.
May 26 05:07:04.421630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:04.421630 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:04.427334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:04.429728 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:04.429728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 26 05:07:04.429728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1b3b56b2-adb0-48e6-8778-2a81fa8e8ad4 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 26 05:07:04.516652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk 1073741824" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:04.518536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:04.520052 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:04.672051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.152s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:04.672640 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:07:04.672974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:04.781502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:04.782575 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Cannot resize image /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:07:04.783176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:07:04.783506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Ensure instance console log exists: /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:07:04.783903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:04.784253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:04.784538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:04.874631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1279e55b-77dd-461e-991f-6a1d3b73f03e req-984954ae-f5e5-4a0b-9d89-d85bd03da512 service nova] Releasing lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:04.876859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquired lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:04.876859 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:04.917492 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:04.923299 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:04.926690 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:05.210032 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-312e1296-9ec6-4eba-8d58-2e867b604921 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:05.425596 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 26 05:07:05.426098 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772025.4257119, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:05.426098 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Started (Lifecycle Event)
May 26 05:07:05.436229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.829s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:05.436229 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:05.444989 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:07:05.532627 np0000001388 nova-compute[98319]: INFO nova.network.neutron [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating port 0504e6f4-659f-4a72-858a-d5dca4e68565 with attributes {'binding:host_id': 'np0000001388', 'device_owner': 'compute:nova'}
May 26 05:07:05.579012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:05.579605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:05.579859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:05.580005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:05.580109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:05.580360 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received unexpected event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with vm_state rescued and task_state None.
May 26 05:07:05.580771 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:05.580945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:05.581099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:05.581237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:05.581400 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:05.581537 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-84dafb7e-3e9b-4834-ab10-9af907b5727b req-2dde52ee-753f-4fc0-ab42-5267a439707b service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received unexpected event network-vif-plugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with vm_state rescued and task_state None.
May 26 05:07:05.647188 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:05.704567 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:05.704854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:05.704854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:05.706067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:05.706067 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:05.706067 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3bbe39b6-64c5-43f2-a24d-003523121ceb req-204742d9-a154-4f14-b0e3-50bd3cf9c136 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received unexpected event network-vif-plugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with vm_state resized and task_state None.
May 26 05:07:05.838277 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating instance_info_cache with network_info: [{"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:05.929944 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:05.936030 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:06.160474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:06.160594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:06.160721 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:06.326577 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.341237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Releasing lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:06.341778 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance network_info: |[{"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:07:06.346507 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Start _get_guest_xml network_info=[{"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:07:06.350840 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:06.353169 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-497066655', uuid='f7383e81-a647-4887-aa33-09977dd902bb'), owner=OwnerMeta(userid='0e5c64df40bd44d89d8f1617f4fa5281', username='tempest-VolumesSnapshotTestJSON-805170533-project-member', projectid='59c0c90d3ca84a4bb5aaf3f1c8245e23', projectname='tempest-VolumesSnapshotTestJSON-805170533'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772026.352596) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:07:06.355990 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:07:06.356723 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:07:06.359845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:07:06.359845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:07:06.364994 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:07:06.364994 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:07:06.365470 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:07:06.365636 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:07:06.365873 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:07:06.366039 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:07:06.366179 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:07:06.366403 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:07:06.366598 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:07:06.366790 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:07:06.366921 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:07:06.367051 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:07:06.382804 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-497066655',display_name='tempest-VolumesSnapshotTestJSON-instance-497066655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-497066655',id=42,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNT0371lrzIYTg9eTOSgenpY0T6pCypEly6aEuPBA1U+Dwn8pEefGqKSdwjq4SzckGE0Y2X/rR0sU3n7Qg00SdHGfaYoTU8/2tImL/J4W5h6/PfvoyXQZR6XonwlPVApg==',key_name='tempest-keypair-506566655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-jr0kvwad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=f7383e81-a647-4887-aa33-09977dd902bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:06.383281 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:06.383941 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:06.384604 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'pci_devices' on Instance uuid f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:06.438639 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 258b4ab0-7d70-4714-b0a8-a1827592acad due to new event <LifecycleEvent: 1779772026.4383247, 258b4ab0-7d70-4714-b0a8-a1827592acad => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:07:06.440225 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772026.4383247, 258b4ab0-7d70-4714-b0a8-a1827592acad => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:06.440225 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Resumed (Lifecycle Event)
May 26 05:07:06.662716 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:06.711630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:06.711866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:06.712083 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Going to confirm migration 3 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 26 05:07:06.888457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <uuid>f7383e81-a647-4887-aa33-09977dd902bb</uuid>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <name>instance-0000002a</name>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-497066655</nova:name>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:07:06</nova:creationTime>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:user uuid="0e5c64df40bd44d89d8f1617f4fa5281">tempest-VolumesSnapshotTestJSON-805170533-project-member</nova:user>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:project uuid="59c0c90d3ca84a4bb5aaf3f1c8245e23">tempest-VolumesSnapshotTestJSON-805170533</nova:project>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         <nova:port uuid="bfad2e7c-9ae2-4ec7-976d-90faac916b69">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="serial">f7383e81-a647-4887-aa33-09977dd902bb</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="uuid">f7383e81-a647-4887-aa33-09977dd902bb</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.config"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:95:f3:f3"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <target dev="tapbfad2e7c-9a"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/console.log" append="off"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:06.888457 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Preparing to wait for external event network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-497066655',display_name='tempest-VolumesSnapshotTestJSON-instance-497066655',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-497066655',id=42,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNT0371lrzIYTg9eTOSgenpY0T6pCypEly6aEuPBA1U+Dwn8pEefGqKSdwjq4SzckGE0Y2X/rR0sU3n7Qg00SdHGfaYoTU8/2tImL/J4W5h6/PfvoyXQZR6XonwlPVApg==',key_name='tempest-keypair-506566655',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-jr0kvwad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=f7383e81-a647-4887-aa33-09977dd902bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:06.892066 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:07:06.892483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.892515 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:06.892763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:07:06.893522 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.893676 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3ea86f0-a72d-5380-a140-906879c141d5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:06.894652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.895539 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:06.897347 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.899437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.899629 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfad2e7c-9a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:06.901382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfad2e7c-9a, col_values=(('qos', UUID('5512afc3-e843-49b6-82da-b1e497f7d0d3')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:06.901382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfad2e7c-9a, col_values=(('external_ids', {'iface-id': 'bfad2e7c-9ae2-4ec7-976d-90faac916b69', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:f3:f3', 'vm-uuid': 'f7383e81-a647-4887-aa33-09977dd902bb'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:06.901382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.902799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:06.908352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:06.909460 np0000001388 nova-compute[98319]: INFO os_vif [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a')
May 26 05:07:06.946813 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:06.949221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:07.049518 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:07.194620 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:07.218338 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:07.276862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:07.338899 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:07.339382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:07.339624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:07.339940 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:07.340144 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'info_cache' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:07.451761 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772027.4514718, 258b4ab0-7d70-4714-b0a8-a1827592acad => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:07.453265 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Started (Lifecycle Event)
May 26 05:07:07.679153 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:07.679844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing instance network info cache due to event network-changed-0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:07.680139 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] Acquiring lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:07.697427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:07.698292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:07:07.698700 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating image(s)
May 26 05:07:07.699206 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:07.699531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:07.700244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] Acquired lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:07.700244 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Refreshing network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:07.701560 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:07.701747 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:07.958180 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:07.964004 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:08.204695 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:08.205666 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.208067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "901a5bdea220570c1a9e471954e49181d8d2a378" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:08.209067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "901a5bdea220570c1a9e471954e49181d8d2a378" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:08.347232 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.356722 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Rescuing
May 26 05:07:08.356889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:08.357044 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:08.357219 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:08.427968 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:08.428160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:08.428306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No VIF found with MAC fa:16:3e:95:f3:f3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:08.428852 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Using config drive
May 26 05:07:08.684064 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.839043 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.870158 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.939448 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:08.944314 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updated VIF entry in instance network info cache for port 0504e6f4-659f-4a72-858a-d5dca4e68565. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:07:08.946645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:09.051728 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:09.112768 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Creating config drive at /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.config
May 26 05:07:09.122852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr1ug3nr8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:09.201664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr1ug3nr8" returned: 0 in 0.078s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:09.328359 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:09.447280 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:09.448117 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:09.448530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:09.472782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-48f88875-0aa9-42a1-b0f9-6a8b4e938a01 req-7e87b67f-e862-43b2-bbee-6e720b18ed57 service nova] Releasing lock "refresh_cache-c6aa2167-8fa0-4795-9166-36d8a29c477a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:09.541344 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:09.556458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:09.556678 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'migration_context' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:09.564089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.part --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:09.564465 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] cfdda07c-8fc3-4597-8631-a058ccd52d92 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:07:09.565566 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:07:09.566080 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.part /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:09.748106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.part /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.converted" returned: 0 in 0.182s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:09.764289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:09.846294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:09.873266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378.converted --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:09.877625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "901a5bdea220570c1a9e471954e49181d8d2a378" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.665s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:09.878151 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:09.882817 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:09.887287 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:09.889385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:09.985705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:10.009436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:10.011249 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "901a5bdea220570c1a9e471954e49181d8d2a378" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:10.011249 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "901a5bdea220570c1a9e471954e49181d8d2a378" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:10.012039 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:10.016138 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:10.016255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:10.049253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:10.064712 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Object Instance<67e6c789-cd47-4a9d-85a4-3c51faa4d646> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:10.076240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:10.076240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:10.141037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:10.144544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378,backing_fmt=raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:10.177667 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb17db8b-4ddc-4b31-a811-c50917c60250 req-b3343cd1-6e72-4164-9199-f0f7b9fed0a3 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:10.178191 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb17db8b-4ddc-4b31-a811-c50917c60250 req-b3343cd1-6e72-4164-9199-f0f7b9fed0a3 service nova] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:10.178668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb17db8b-4ddc-4b31-a811-c50917c60250 req-b3343cd1-6e72-4164-9199-f0f7b9fed0a3 service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:10.178933 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb17db8b-4ddc-4b31-a811-c50917c60250 req-b3343cd1-6e72-4164-9199-f0f7b9fed0a3 service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:10.179161 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb17db8b-4ddc-4b31-a811-c50917c60250 req-b3343cd1-6e72-4164-9199-f0f7b9fed0a3 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Processing event network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:07:10.224875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378,backing_fmt=raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk 1073741824" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:10.227536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "901a5bdea220570c1a9e471954e49181d8d2a378" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:10.227536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:10.345451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/901a5bdea220570c1a9e471954e49181d8d2a378 --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:10.346274 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'migration_context' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:10.365838 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:10.368875 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:10.402594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:10.852589 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:10.853049 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Rebasing disk image.
May 26 05:07:10.853405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:10.949754 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:07:10.950351 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772030.9499395, f7383e81-a647-4887-aa33-09977dd902bb => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:10.951096 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] VM Started (Lifecycle Event)
May 26 05:07:10.956067 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:07:10.958249 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance spawned successfully.
May 26 05:07:10.958673 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:07:10.962653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:10.963243 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d -F raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:11.371397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:11.371397 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:11.456228 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:11.458663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:11.474003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.474003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.474003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.474003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.474003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.475593 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:11.772824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:11.776476 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:11.817282 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:11.873659 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:11.903055 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:11.982774 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:07:11.983402 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772031.983056, f7383e81-a647-4887-aa33-09977dd902bb => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:11.983696 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] VM Paused (Lifecycle Event)
May 26 05:07:11.992246 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Took 7.84 seconds to spawn the instance on the hypervisor.
May 26 05:07:11.995341 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:11.998643 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:11.999024 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:11.999238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:11.999411 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:11.999765 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:11.999958 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6009016d-e3aa-4561-b9c6-600ccce3d5de req-069feca0-057c-4b66-a416-1745492f1807 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state active and task_state rescuing.
May 26 05:07:12.027849 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:12.042669 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:12.080070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d -F raw /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk" returned: 0 in 1.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:12.081766 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:07:12.083058 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Ensure instance console log exists: /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:07:12.084032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:12.087214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:12.087214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:12.090386 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start _get_guest_xml network_info=[{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c307f02dbac1bb33dd607dead46ad04c',container_format='bare',created_at=2026-05-26T05:06:43Z,direct_url=<?>,disk_format='qcow2',id=cfdda07c-8fc3-4597-8631-a058ccd52d92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-97965079-shelved',owner='b6925a7d36eb4b919388468635037918',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-26T05:06:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:07:12.091820 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00044488599996839184 future=<Future at 0x7d7aa4431670 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:12.091883 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:12.104978 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:12.110014 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:12.113463 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-97965079', uuid='c6aa2167-8fa0-4795-9166-36d8a29c477a'), owner=OwnerMeta(userid='fdb1ab2deb1f45f3a5cb5374e0e8dea1', username='tempest-AttachVolumeShelveTestJSON-946543145-project-member', projectid='b6925a7d36eb4b919388468635037918', projectname='tempest-AttachVolumeShelveTestJSON-946543145'), image=ImageMeta(id='cfdda07c-8fc3-4597-8631-a058ccd52d92', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772032.1112828) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:07:12.113463 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:12.124116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:07:12.124116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:07:12.124116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:07:12.124116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:07:12.124933 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:07:12.125297 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c307f02dbac1bb33dd607dead46ad04c',container_format='bare',created_at=2026-05-26T05:06:43Z,direct_url=<?>,disk_format='qcow2',id=cfdda07c-8fc3-4597-8631-a058ccd52d92,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-97965079-shelved',owner='b6925a7d36eb4b919388468635037918',properties=ImageMetaProps,protected=<?>,size=53608448,status='active',tags=<?>,updated_at=2026-05-26T05:06:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:07:12.125479 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:07:12.125621 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:07:12.125780 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:07:12.125913 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:07:12.125999 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:07:12.126143 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:07:12.126345 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:07:12.126478 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:07:12.126612 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:07:12.126827 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:07:12.127006 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:12.138786 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance destroyed successfully.
May 26 05:07:12.139534 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'numa_topology' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:12.233345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:12.233692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:12.233692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:12.233775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:12.234173 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] No waiting events found dispatching network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:12.234173 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-954c49f2-eaba-4201-805b-b82b26fe9243 req-b19241b3-b5ae-4128-b951-0811899493d6 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received unexpected event network-vif-plugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 for instance with vm_state active and task_state None.
May 26 05:07:12.279366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:12.508929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:12.511109 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772032.510877, f7383e81-a647-4887-aa33-09977dd902bb => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:12.511266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] VM Resumed (Lifecycle Event)
May 26 05:07:12.517736 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Took 13.50 seconds to build instance.
May 26 05:07:12.631601 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:12.648990 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Attempting rescue
May 26 05:07:12.649610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 05:07:12.654914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='cfdda07c-8fc3-4597-8631-a058ccd52d92',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1986219734',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:01Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:06:49.933563',shelved_host='np0000001388',shelved_image_id='cfdda07c-8fc3-4597-8631-a058ccd52d92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:12.655153 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:12.657432 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:12.658842 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'pci_devices' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:12.663054 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:07:12.663187 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Creating image(s)
May 26 05:07:12.663994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:12.664131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:12.664829 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:12.664930 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'trusted_certs' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:12.894679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.819s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:13.013716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:13.018899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:13.021857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.011s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:13.162288 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <uuid>c6aa2167-8fa0-4795-9166-36d8a29c477a</uuid>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <name>instance-00000026</name>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-97965079</nova:name>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:07:12</nova:creationTime>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:user uuid="fdb1ab2deb1f45f3a5cb5374e0e8dea1">tempest-AttachVolumeShelveTestJSON-946543145-project-member</nova:user>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:project uuid="b6925a7d36eb4b919388468635037918">tempest-AttachVolumeShelveTestJSON-946543145</nova:project>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         <nova:port uuid="0504e6f4-659f-4a72-858a-d5dca4e68565">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="serial">c6aa2167-8fa0-4795-9166-36d8a29c477a</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="uuid">c6aa2167-8fa0-4795-9166-36d8a29c477a</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a5:27:7f"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <target dev="tap0504e6f4-65"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/console.log" append="off"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:13.163423 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Preparing to wait for external event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:13.163423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:13.165901 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='cfdda07c-8fc3-4597-8631-a058ccd52d92',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-1986219734',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:01Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member',shelved_at='2026-05-26T05:06:49.933563',shelved_host='np0000001388',shelved_image_id='cfdda07c-8fc3-4597-8631-a058ccd52d92'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:07:13.165901 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:13.165901 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:13.165901 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:07:13.168081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.168081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:13.168081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:07:13.169730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.169730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3df61656-0887-5ed3-a334-0b12f1f802a9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:13.169730 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:13.170319 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:13.173492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.173492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:13.178213 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:13.180136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.180659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:13.181015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:13.181440 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:13.183720 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:13.184028 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:13.197137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.199496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0504e6f4-65, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:13.203142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0504e6f4-65, col_values=(('qos', UUID('83763bce-04af-44c8-8f6f-ec4adbb8101b')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:13.203679 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0504e6f4-65, col_values=(('external_ids', {'iface-id': '0504e6f4-659f-4a72-858a-d5dca4e68565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:27:7f', 'vm-uuid': 'c6aa2167-8fa0-4795-9166-36d8a29c477a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:13.205096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.208762 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:13.220256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:13.222631 np0000001388 nova-compute[98319]: INFO os_vif [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65')
May 26 05:07:13.295858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:13.296629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:13.360136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.rescue" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:13.360690 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.180s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:13.361667 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'migration_context' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:13.530190 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-changed-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:13.530190 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Refreshing instance network info cache due to event network-changed-bfad2e7c-9ae2-4ec7-976d-90faac916b69. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:13.530441 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] Acquiring lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:13.532019 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] Acquired lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:13.533377 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Refreshing network info cache for port bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:13.534952 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.996953558000314 future=<Future at 0x7d7aa45dcb00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:13.535239 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.996498620000239 future=<Future at 0x7d7aa45dcb00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:13.536527 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.995410020000236 future=<Future at 0x7d7aa45dcb00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:13.603304 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocation for migration a0c74b03-01d5-4e1f-8724-02c0774172f2
May 26 05:07:13.866240 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:13.866592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:07:13.867247 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start _get_guest_xml network_info=[{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:9d:0f:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:07:13.867469 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:14.036546 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:14.094990 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:14.095372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:14.095592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:14.095774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:14.095973 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:14.096104 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b6b2a667-2174-4d7c-9d40-e31543740f99 req-046ad94a-7c6a-449a-a002-4e66f43f21b8 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state active and task_state rescuing.
May 26 05:07:14.109337 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4f531ab4-93d1-4ee8-8365-5139d2816154 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 7.397s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:14.370009 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:14.376240 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:14.377257 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1279744446', uuid='debb889d-e74c-4caa-b278-826a5ed536e0'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:9d:0f:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772034.3766856) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:07:14.380592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:07:14.381535 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:07:14.383576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:07:14.383992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:07:14.385301 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:07:14.386314 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:07:14.386769 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:07:14.387007 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:07:14.387302 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:07:14.387938 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:07:14.389334 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:07:14.389334 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:07:14.389334 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:07:14.389334 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:07:14.389334 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:07:14.390252 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:07:14.390716 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'vcpu_model' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:14.484359 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:14.652366 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updated VIF entry in instance network info cache for port bfad2e7c-9ae2-4ec7-976d-90faac916b69. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:07:14.652613 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating instance_info_cache with network_info: [{"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:14.760523 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:14.760733 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:14.760958 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] No VIF found with MAC fa:16:3e:a5:27:7f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:14.761494 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Using config drive
May 26 05:07:14.894446 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:14.916114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279744446',display_name='tempest-ServerRescueNegativeTestJSON-server-1279744446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-1279744446',id=40,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:49Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-lxe4ad61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:06:49Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=debb889d-e74c-4caa-b278-826a5ed536e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:9d:0f:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:14.916114 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:9d:0f:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:14.917094 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:14.917911 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:15.154698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f08b0d70-77c5-45aa-8ba2-0ea837e678ea req-205c58e4-4940-4d66-99c6-d58a88c7f78a service nova] Releasing lock "refresh_cache-f7383e81-a647-4887-aa33-09977dd902bb" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:15.266383 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'ec2_ids' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:15.421843 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:15.425230 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <uuid>debb889d-e74c-4caa-b278-826a5ed536e0</uuid>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <name>instance-00000028</name>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1279744446</nova:name>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:07:14</nova:creationTime>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         <nova:port uuid="96479187-86e9-4e4d-b112-d286c23de3d7">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="serial">debb889d-e74c-4caa-b278-826a5ed536e0</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="uuid">debb889d-e74c-4caa-b278-826a5ed536e0</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.rescue"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config.rescue"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:9d:0f:6c"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <target dev="tap96479187-86"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/console.log" append="off"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:15.425230 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:15.435431 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance destroyed successfully.
May 26 05:07:15.601489 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:15.601489 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing instance network info cache due to event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:15.601489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:15.601489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:15.601489 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:15.770834 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:15.770996 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'keypairs' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:16.106064 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:16.277980 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Object Instance<c6aa2167-8fa0-4795-9166-36d8a29c477a> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:16.296899 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:16.474229 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:16.519362 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Creating config drive at /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config
May 26 05:07:16.527026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjgp6vao {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:16.596889 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcjgp6vao" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:16.662399 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updated VIF entry in instance network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:07:16.663145 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:16.964642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:16.965998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:16.965998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:16.965998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:9d:0f:6c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:16.966630 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Using config drive
May 26 05:07:17.058306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.092167 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.095384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.172563 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:17.172631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:17.172759 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing instance network info cache due to event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:17.172987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:17.173100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:17.173224 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:17.187057 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.281646 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.293474 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a4b67004-099e-441d-b8a9-12369a8d57cb req-91a7994a-9236-476f-b91e-3ad8b6bae76b service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:17.293780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4b67004-099e-441d-b8a9-12369a8d57cb req-91a7994a-9236-476f-b91e-3ad8b6bae76b service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:17.294047 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4b67004-099e-441d-b8a9-12369a8d57cb req-91a7994a-9236-476f-b91e-3ad8b6bae76b service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:17.294181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4b67004-099e-441d-b8a9-12369a8d57cb req-91a7994a-9236-476f-b91e-3ad8b6bae76b service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:17.294336 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a4b67004-099e-441d-b8a9-12369a8d57cb req-91a7994a-9236-476f-b91e-3ad8b6bae76b service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Processing event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:07:17.467123 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.470750 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'ec2_ids' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:17.476260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.481718 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.506618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.527814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:17.679775 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:17.968081 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772037.9674163, c6aa2167-8fa0-4795-9166-36d8a29c477a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:17.968385 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Started (Lifecycle Event)
May 26 05:07:17.969832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:07:17.974441 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:17.974441 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'keypairs' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:17.975503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:07:17.984376 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance spawned successfully.
May 26 05:07:18.088589 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:18.206666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:18.291545 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updated VIF entry in instance network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:07:18.292699 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:18.391048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:18.471964 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:18.474909 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:18.480686 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:18.484966 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:18.655098 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Creating config drive at /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config.rescue
May 26 05:07:18.658165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1j2byi3r {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:18.717265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1j2byi3r" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:18.796788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7c23431-7850-4565-9923-196ea69eebf1 req-7dcf5b83-a6ca-447c-8ef5-71c0b3220ba7 service nova] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:18.906394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-72106b18-5cf2-414a-a077-7a69fd8ab6b8 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.959s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:18.979069 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772038.9786243, c6aa2167-8fa0-4795-9166-36d8a29c477a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:18.979304 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Paused (Lifecycle Event)
May 26 05:07:19.228989 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:19.263049 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:19.356787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:19.381350 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:19.383445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:19.383445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:19.383445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:19.383445 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:19.383534 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-39b6a2ab-e2fa-43cd-95d9-cdccd3ba8c51 req-ba370908-c10d-4894-9fbe-31ff6a714532 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received unexpected event network-vif-plugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with vm_state active and task_state None.
May 26 05:07:19.456587 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:19.458672 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:19.485316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:19.493039 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772039.492586, c6aa2167-8fa0-4795-9166-36d8a29c477a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:19.493278 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Resumed (Lifecycle Event)
May 26 05:07:19.996058 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:20.000866 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:20.111902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b2aadb60-08ac-48ae-8ddd-d70535711386 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:20.503951 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for debb889d-e74c-4caa-b278-826a5ed536e0 due to new event <LifecycleEvent: 1779772040.5035632, debb889d-e74c-4caa-b278-826a5ed536e0 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:07:20.504584 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772040.5035632, debb889d-e74c-4caa-b278-826a5ed536e0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:20.504584 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Resumed (Lifecycle Event)
May 26 05:07:21.010278 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:21.016160 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:21.470461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:21.474773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:21.475644 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:21.477375 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-5a0e331d-9f7e-4369-abeb-9eb4155dbd2f req-997968f1-5143-421a-8b41-ec7f4da19dfc service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:21.522499 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772041.5219183, debb889d-e74c-4caa-b278-826a5ed536e0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:21.522499 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Started (Lifecycle Event)
May 26 05:07:21.666728 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Unrescuing
May 26 05:07:21.667150 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:21.667150 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:21.667283 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:22.025021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:22.028517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:22.173231 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:22.287301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:22.530624 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 05:07:22.592795 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:22.814345 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [{"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:23.208937 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:23.317736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-debb889d-e74c-4caa-b278-826a5ed536e0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:23.317736 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'flavor' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:23.857159 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:23.861650 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:23.882551 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:24.065996 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:24.065996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:24.066800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:24.067847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:24.068791 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:24.070101 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-c264c8f0-1797-4479-b7e0-3cdb648e93b4 req-e9a515ee-a700-4284-badb-e6acce90f00f service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:24.075785 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:24.083652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:24.203545 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999510596999698 future=<Future at 0x7d7aa44f3e00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:24.207078 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance destroyed successfully.
May 26 05:07:24.207883 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'numa_topology' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:24.501408 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:24.502045 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:24.617670 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:24.618040 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:24.711361 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<debb889d-e74c-4caa-b278-826a5ed536e0> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:07:25.200773 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.229927 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.236667 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.340359 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.424800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.427226 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:25.617836 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:25.619213 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:26.149818 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:26.150285 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:26.152716 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-2f09879c-df66-4818-9adf-903ccadfcdb6 req-2a6138c6-da14-4951-9e16-a147ea12f610 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received unexpected event network-vif-plugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with vm_state rescued and task_state unrescuing.
May 26 05:07:26.203226 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for debb889d-e74c-4caa-b278-826a5ed536e0 due to new event <LifecycleEvent: 1779772046.200689, debb889d-e74c-4caa-b278-826a5ed536e0 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:07:26.203226 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772046.200689, debb889d-e74c-4caa-b278-826a5ed536e0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:26.203226 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Resumed (Lifecycle Event)
May 26 05:07:26.203226 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-520548f0-6d22-4b42-8b8e-14ee662996e7 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:26.502225 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:26.502581 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:26.617737 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:26.618284 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:26.704956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:26.710993 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:27.214713 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772047.214154, debb889d-e74c-4caa-b278-826a5ed536e0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:27.214713 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Started (Lifecycle Event)
May 26 05:07:27.288581 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:27.718142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:27.724083 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:28.209787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:28.533230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0009218349996444886 future=<Future at 0x7d7aa45dcb00 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:28.533230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:28.533230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.669787059999635 future=<Future at 0x7d7aa44f3e00 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:28.533230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.669691411999793 future=<Future at 0x7d7aa44f3e00 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:28.533230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:28.617920 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:28.618337 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:28.618657 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:29.135232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:29.135232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:29.135232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:29.135232 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:07:30.192341 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.322703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.323838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.433839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.443050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:30.443530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:30.447267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.563880 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.564311 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.665166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.678072 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:07:30.682990 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.789895 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.795035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.895659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:30.901473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:30.950488 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:07:31.000350 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.001275 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.103708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.104176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.198501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.199641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.299098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.303547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.403680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.404217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.514236 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.514686 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:07:31.523303 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.579231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:31.579231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:31.586429 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:07:31.587613 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Claim successful on node np0000001388
May 26 05:07:31.642443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.646678 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.755080 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.759863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.874109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.874688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:31.974016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:31.981418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:32.091822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:32.091822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:32.216344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.125s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:32.216768 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:07:32.221981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:32.295380 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:32.324655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:32.325205 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:32.417392 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:32.417911 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:07:32.421327 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:32.422598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:32.479501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:32.480184 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=11270MB free_disk=72.7706413269043GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:07:32.480453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:32.682251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:32.682485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:33.189459 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Detaching volume 52adf80f-a9b8-4438-9dbe-b3217131fbb4
May 26 05:07:33.213096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:33.268560 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Attempting to driver detach volume 52adf80f-a9b8-4438-9dbe-b3217131fbb4 from mountpoint /dev/vdb
May 26 05:07:33.282811 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found disk vdb by alias ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:07:33.283746 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Found disk vdb by alias ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:07:33.284767 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Attempting to detach device vdb from instance e44fef6b-6d4c-49b1-977e-3d190c009d28 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:07:33.284767 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <alias name="ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4"/>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <serial>52adf80f-a9b8-4438-9dbe-b3217131fbb4</serial>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]: </disk>
May 26 05:07:33.284767 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:07:33.298027 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully detached device vdb from instance e44fef6b-6d4c-49b1-977e-3d190c009d28 from the persistent domain config.
May 26 05:07:33.298027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] (1/8): Attempting to detach device vdb with device alias ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4 from instance e44fef6b-6d4c-49b1-977e-3d190c009d28 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:07:33.298027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <alias name="ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4"/>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <serial>52adf80f-a9b8-4438-9dbe-b3217131fbb4</serial>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]: </disk>
May 26 05:07:33.298027 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:07:33.308436 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:33.308792 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:33.812063 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:33.928184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4 for instance e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:07:33.929057 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772053.9287522, e44fef6b-6d4c-49b1-977e-3d190c009d28 => ua-52adf80f-a9b8-4438-9dbe-b3217131fbb4> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:07:33.933822 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully detached device vdb from instance e44fef6b-6d4c-49b1-977e-3d190c009d28 from the live domain config.
May 26 05:07:33.934950 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:07:33.935358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:07:33.935511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:33.935894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:33.936225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '52adf80f-a9b8-4438-9dbe-b3217131fbb4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:07:33.936439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434ff989-8c7d-4620-889b-55986129cb83 (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:33.970070 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsi session list stdout=tcp: [102] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [103] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4 (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [108] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-434ff989-8c7d-4620-889b-55986129cb83 (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:33.970540 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:33.970685 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', '102'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', '103'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-434ff989-8c7d-4620-889b-55986129cb83', '108'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:07:33.970816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', '103')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:07:33.971940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4', '102')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:07:33.972894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46cbba0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:07:33.973126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:07:33.973680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Flush multipath device 330000000489b974b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:07:34.007133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:07:34.055000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:07:34.102908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:07:34.103220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:07:34.104813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:07:34.125063 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:07:34.125063 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:07:34.139259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.175815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 103, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.40.100,3260]
May 26 05:07:34.175815 np0000001388 nova-compute[98319]: Logout of [sid: 103, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.40.100,3260] successful.
May 26 05:07:34.175815 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.196324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.209235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.243517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 102, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.50.100,3260]
May 26 05:07:34.243517 np0000001388 nova-compute[98319]: Logout of [sid: 102, target: iqn.2023-03.storpool.com:os--volume-52adf80f-a9b8-4438-9dbe-b3217131fbb4, portal: 192.168.50.100,3260] successful.
May 26 05:07:34.243517 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.258533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:34.258782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:34.258937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] <== disconnect_volume: return (323ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:34.259100 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:07:34.321431 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.742s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:34.322489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 1.841s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:34.323382 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:07:34.822958 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'flavor' on Instance uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:34.828989 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:07:34.829955 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:07:34.830600 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:34.831060 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:34.914728 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f0799194be46487e89960ac774578992', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b22c1abf2f4ba788005f454c7f8add', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:07:35.340832 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:07:35.430387 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.430690 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.430982 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a921deec-f5fe-4c81-a5c2-df30f947a826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.431439 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e44fef6b-6d4c-49b1-977e-3d190c009d28 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.431656 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7583fee2-acf9-4217-ad23-adca4ec3e186 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.431879 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance debb889d-e74c-4caa-b278-826a5ed536e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.432068 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.432285 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 258b4ab0-7d70-4714-b0a8-a1827592acad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.432441 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f7383e81-a647-4887-aa33-09977dd902bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.432610 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c6aa2167-8fa0-4795-9166-36d8a29c477a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.432791 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance b71f2db5-8f92-4400-bf45-634f9790fca0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:07:35.433030 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:07:35.434897 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2688MB phys_disk=95GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:07:32 up 39 min,  2 users,  load average: 6.88, 7.21, 4.52\n', 'num_instances': '11', 'num_vm_active': '9', 'num_task_None': '11', 'num_os_type_None': '11', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '5', 'io_workload': '1', 'num_proj_c32d47b7a83249e09dab2cfa30367843': '1', 'num_proj_68b22c1abf2f4ba788005f454c7f8add': '3', 'num_vm_rescued': '1', 'num_proj_59c0c90d3ca84a4bb5aaf3f1c8245e23': '1', 'num_vm_building': '1', 'num_proj_b6925a7d36eb4b919388468635037918': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:07:35.511314 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Successfully created port: fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:07:35.851987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-de4410b1-6e6b-4a52-8c8a-e9bf8b5a475a tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:35.853354 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:07:36.050306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:36.050502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:36.050694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:36.050850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:36.050988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:36.055744 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Terminating instance
May 26 05:07:36.185942 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:36.186181 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:36.208595 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Successfully updated port: fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:07:36.274339 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:36.274464 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing instance network info cache due to event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:36.274611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:36.274721 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:36.274834 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:36.563436 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:07:36.585751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.592562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.614307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.626373 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.649787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.657786 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.689581 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:36.712672 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:36.779722 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:36.815590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:36.815798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:36.815997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:36.816129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:36.816301 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] No waiting events found dispatching network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:36.816479 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-65787908-c6bb-4219-919a-ac82f2366da5 req-564d364a-1abc-4b4f-ac6d-e370ac7b90bc service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:07:36.862258 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:07:36.864344 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:07:36.864977 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Creating image(s)
May 26 05:07:36.865501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:36.865783 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:36.866175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:36.866705 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:36.870069 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:36.871389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:36.892716 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.901373 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:07:36.905986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:36.937282 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999578805000056 future=<Future at 0x7d7aa437a9c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:36.943761 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.993115293999836 future=<Future at 0x7d7aa437a9c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:36.944367 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.992463317999864 future=<Future at 0x7d7aa437a9c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:36.947709 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Instance destroyed successfully.
May 26 05:07:36.948441 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lazy-loading 'resources' on Instance uuid e44fef6b-6d4c-49b1-977e-3d190c009d28 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:36.986117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:36.986599 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:36.987218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:36.987710 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:36.993148 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:07:36.993851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:37.093458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:37.093985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:37.126699 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:37.161345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk 1073741824" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:37.161951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.175s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:37.162355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:37.201239 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:07:37.201618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.880s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:37.202114 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:37.270486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:37.270986 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:07:37.271178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:37.299598 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.392191 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:37.392191 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Cannot resize image /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:07:37.392191 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:07:37.392191 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Ensure instance console log exists: /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:07:37.393925 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:37.393925 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:37.394081 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:37.454486 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesBackupsTest-instance-564208652',display_name='tempest-VolumesBackupsTest-instance-564208652',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesbackupstest-instance-564208652',id=37,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL/dMkcOh3IZEBePi+wK1paytLdf35m4/5dHVwtEDpjI8FiFhXw+cRWrWuCs0I/Nq9Eprn7rVlKUySFsqbMd+tNDn1doy6DKNu/qfzAn5sYxnOfjI6pAXKzZ1fsfY79k5Q==',key_name='tempest-keypair-1870345677',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:05:53Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c32d47b7a83249e09dab2cfa30367843',ramdisk_id='',reservation_id='r-9x7g0ide',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesBackupsTest-2047315277',owner_user_name='tempest-VolumesBackupsTest-2047315277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59079210c217429e88a1c824524b9772',uuid=e44fef6b-6d4c-49b1-977e-3d190c009d28,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:07:37.456705 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converting VIF {"id": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "address": "fa:16:3e:4e:41:af", "network": {"id": "3dd3e1b8-7b47-4113-99b9-3e7db978ddf0", "bridge": "br-int", "label": "tempest-VolumesBackupsTest-1871638787-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "c32d47b7a83249e09dab2cfa30367843", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap71964717-ea", "ovs_interfaceid": "71964717-ea6b-4cd4-b87e-2db4de8c5f1c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:37.456705 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:37.456705 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:07:37.463062 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.463418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71964717-ea, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:37.465238 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Stashing vm_state: active {{(pid=98319) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}}
May 26 05:07:37.475666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.476668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:37.479857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.482075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.482497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d6563e8-b05f-4f26-a59d-3da2ebf32840) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:37.483275 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:37.485107 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:37.490283 np0000001388 nova-compute[98319]: INFO os_vif [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:41:af,bridge_name='br-int',has_traffic_filtering=True,id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c,network=Network(3dd3e1b8-7b47-4113-99b9-3e7db978ddf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71964717-ea')
May 26 05:07:37.490283 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Deleting instance files /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28_del
May 26 05:07:37.490283 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Deletion of /opt/stack/data/nova/instances/e44fef6b-6d4c-49b1-977e-3d190c009d28_del complete
May 26 05:07:37.632811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-574843a3-25d5-40d1-ae1c-dbb57d790113 req-bc61a4f8-de2c-43fd-b6aa-2866df52bf59 service nova] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:37.633767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:37.633965 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:38.006759 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Took 1.44 seconds to destroy the instance on the hypervisor.
May 26 05:07:38.007748 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:07:38.008238 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:07:38.008415 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:07:38.008758 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:38.032561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:38.033046 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:38.103161 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:38.201518 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:07:38.201518 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:07:38.202062 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.30 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:38.259694 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:07:38.511403 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:38.544141 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:07:38.544419 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Claim successful on node np0000001388
May 26 05:07:38.748849 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:38.824987 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-acdadc28-c7fc-45d3-8d1c-6ee21aba3828 req-f04964f6-30c7-4bb3-b248-6fa049741daa service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-deleted-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:38.825620 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-acdadc28-c7fc-45d3-8d1c-6ee21aba3828 req-f04964f6-30c7-4bb3-b248-6fa049741daa service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Neutron deleted interface 71964717-ea6b-4cd4-b87e-2db4de8c5f1c; detaching it from the instance and deleting it from the info cache
May 26 05:07:38.832645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-acdadc28-c7fc-45d3-8d1c-6ee21aba3828 req-f04964f6-30c7-4bb3-b248-6fa049741daa service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:38.906313 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:38.906528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] Acquiring lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:38.907121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:38.907343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:38.907524 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] No waiting events found dispatching network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:38.907670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-45b48bd2-4b13-428b-811d-971a48c19681 req-ad1ccf8b-ed60-4e12-b3e5-f977264b33f6 service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Received event network-vif-unplugged-71964717-ea6b-4cd4-b87e-2db4de8c5f1c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:07:39.052179 np0000001388 nova-compute[98319]: INFO nova.compute.resource_tracker [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating resource usage from migration 0ab5ba5d-7865-4c21-bdb4-55376e001d72
May 26 05:07:39.257158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:39.257489 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance network_info: |[{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:07:39.260154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start _get_guest_xml network_info=[{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:07:39.260346 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:39.266023 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:39.269397 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-408518215', uuid='b71f2db5-8f92-4400-bf45-634f9790fca0'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772059.2682204) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:07:39.272611 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:07:39.274441 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:07:39.275860 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:07:39.276770 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:07:39.279840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:07:39.280308 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:07:39.281597 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:07:39.285511 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:07:39.286232 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:07:39.304430 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408518215',display_name='tempest-ServerRescueNegativeTestJSON-server-408518215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-408518215',id=43,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQA5euGQIXjkEDpFcEJt5fV8GhcPsOhTy6qROxtoGZT8rOzobviV08JWyiVPQbnrIuo7DyUwthH2j6fP9r4K+SNbTVM//Rx8D59+kVPF36sliDmpGym7Xb3zJg4hvy1fA==',key_name='tempest-keypair-1240985616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-m99l0iin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0799194be46487e89960ac774578992',uuid=b71f2db5-8f92-4400-bf45-634f9790fca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:39.304952 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:39.305763 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:39.306676 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:39.336123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-acdadc28-c7fc-45d3-8d1c-6ee21aba3828 req-f04964f6-30c7-4bb3-b248-6fa049741daa service nova] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Detach interface failed, port_id=71964717-ea6b-4cd4-b87e-2db4de8c5f1c, reason: Instance e44fef6b-6d4c-49b1-977e-3d190c009d28 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:07:39.764727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Took 1.76 seconds to deallocate network for instance.
May 26 05:07:39.777718 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:39.777959 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <uuid>b71f2db5-8f92-4400-bf45-634f9790fca0</uuid>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <name>instance-0000002b</name>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408518215</nova:name>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:07:39</nova:creationTime>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         <nova:port uuid="fa4d215b-14db-4e8f-9be5-2be67ea1745d">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="serial">b71f2db5-8f92-4400-bf45-634f9790fca0</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="uuid">b71f2db5-8f92-4400-bf45-634f9790fca0</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:14:7a:24"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <target dev="tapfa4d215b-14"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/console.log" append="off"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:39.813443 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Preparing to wait for external event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408518215',display_name='tempest-ServerRescueNegativeTestJSON-server-408518215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-408518215',id=43,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQA5euGQIXjkEDpFcEJt5fV8GhcPsOhTy6qROxtoGZT8rOzobviV08JWyiVPQbnrIuo7DyUwthH2j6fP9r4K+SNbTVM//Rx8D59+kVPF36sliDmpGym7Xb3zJg4hvy1fA==',key_name='tempest-keypair-1240985616',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-m99l0iin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0799194be46487e89960ac774578992',uuid=b71f2db5-8f92-4400-bf45-634f9790fca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:07:39.813443 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:39.816780 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:39.817386 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:07:39.817710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.817922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:39.818142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:07:39.818897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.819053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9006c73-1601-5ffd-a08e-b81cab6789b7', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:39.819981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.820836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:39.821242 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.822957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.823112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa4d215b-14, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:39.823413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa4d215b-14, col_values=(('qos', UUID('8ce3cca7-88be-43f9-935d-9f573cb3fec8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:39.823592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa4d215b-14, col_values=(('external_ids', {'iface-id': 'fa4d215b-14db-4e8f-9be5-2be67ea1745d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:7a:24', 'vm-uuid': 'b71f2db5-8f92-4400-bf45-634f9790fca0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:39.824551 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.826076 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:39.831627 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:39.832840 np0000001388 nova-compute[98319]: INFO os_vif [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14')
May 26 05:07:40.276854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:40.280523 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:40.789901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 2.757s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:40.790375 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Migrating
May 26 05:07:40.790375 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:07:40.797665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.521s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:41.314838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:41.314994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:41.315251 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:41.354317 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:41.354317 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:41.354317 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:14:7a:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:41.354317 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Using config drive
May 26 05:07:41.451324 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:07:41.451509 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:07:41.817711 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:41.859707 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:41.891103 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:07:41.954234 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:07:42.040874 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Creating config drive at /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config
May 26 05:07:42.044751 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprdpmvqsl {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:42.101662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprdpmvqsl" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:42.227482 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:42.305225 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.418712 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:42.468056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.670s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:42.538024 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Deleted allocations for instance e44fef6b-6d4c-49b1-977e-3d190c009d28
May 26 05:07:42.606427 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.631470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.725907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.782296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.783020 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:42.791060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5f975acf-8ac7-4396-9bf4-83eea7fbfd9c req-ffc09109-9277-4e3d-a2d9-274a9bc4f5a3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:42.791157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f975acf-8ac7-4396-9bf4-83eea7fbfd9c req-ffc09109-9277-4e3d-a2d9-274a9bc4f5a3 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:42.791329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f975acf-8ac7-4396-9bf4-83eea7fbfd9c req-ffc09109-9277-4e3d-a2d9-274a9bc4f5a3 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:42.791602 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5f975acf-8ac7-4396-9bf4-83eea7fbfd9c req-ffc09109-9277-4e3d-a2d9-274a9bc4f5a3 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:42.791698 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5f975acf-8ac7-4396-9bf4-83eea7fbfd9c req-ffc09109-9277-4e3d-a2d9-274a9bc4f5a3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Processing event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:07:42.922714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:43.549348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-20032f67-420b-4ef9-a378-c24ef45708d5 tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Lock "e44fef6b-6d4c-49b1-977e-3d190c009d28" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.499s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:43.552429 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772063.5516298, b71f2db5-8f92-4400-bf45-634f9790fca0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:43.552429 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Started (Lifecycle Event)
May 26 05:07:43.553653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:07:43.558234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:07:43.562149 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance spawned successfully.
May 26 05:07:43.563658 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:07:44.056826 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:44.059263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:44.072006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.072148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.072576 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.072847 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.073122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.073411 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:07:44.251304 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.438824 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Starting migrate_disk_and_power_off {{(pid=98319) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12600}}
May 26 05:07:44.475527 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.500611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.561547 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:07:44.561827 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772064.561546, b71f2db5-8f92-4400-bf45-634f9790fca0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:44.561991 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Paused (Lifecycle Event)
May 26 05:07:44.580291 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Took 7.72 seconds to spawn the instance on the hypervisor.
May 26 05:07:44.580291 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:44.691084 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.698437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.797785 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance destroyed successfully.
May 26 05:07:44.801070 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:07:44.801301 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:44.802231 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:44.802604 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:07:44.808938 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.809081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8308c82-1a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:44.811516 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.811797 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:44.813410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.814399 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.817778 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=069eb252-94ad-46ec-9195-d2ad47b9ea2e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:44.820922 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:44.820922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:44.824322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:44.824705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:44.824946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:44.825184 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:44.825410 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-30c8387d-b5c0-488b-8f3d-c7976b6c359f req-33abb045-986d-49f4-af7c-b896665de735 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received unexpected event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with vm_state active and task_state resize_migrating.
May 26 05:07:44.825862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:44.832801 np0000001388 nova-compute[98319]: INFO os_vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a')
May 26 05:07:44.874439 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:44.874692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:44.874842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:44.875012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:44.875315 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:44.875651 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-33ebdcfe-a8f0-4b0c-bfe1-2d87a8a93ae5 req-1211b5c5-c2fd-47b2-801b-fa2d0cab634f service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state active and task_state None.
May 26 05:07:45.067277 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:45.069373 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772065.06908, b71f2db5-8f92-4400-bf45-634f9790fca0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:45.069519 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Resumed (Lifecycle Event)
May 26 05:07:45.105433 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Took 13.64 seconds to build instance.
May 26 05:07:45.390417 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Detected multiple connections on this host for volume: 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, skipping target disconnect.
May 26 05:07:45.393585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:45.489264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:45.489264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:45.572742 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:45.577049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:07:45.586961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:45.587511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:07:45.588297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:45.615304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.170s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:45.708780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:45.709158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk.config /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:45.775826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk.config /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:45.776219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk.info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:45.822773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "cp -r /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_resize/disk.info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:46.081383 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999568323999938 future=<Future at 0x7d7aa43c3b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:46.920625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:46.920885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:46.921134 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:46.922477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:46.924320 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:46.925099 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received unexpected event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with vm_state active and task_state resize_migrating.
May 26 05:07:46.925846 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:46.925846 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing instance network info cache due to event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:07:46.925846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:46.925846 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:46.926287 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:07:46.973649 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:46.974058 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:47.034346 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Port a8308c82-1af4-4f92-9424-20cd5c165b63 binding to destination host np0000001388 is already ACTIVE {{(pid=98319) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}}
May 26 05:07:47.308604 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:47.428631 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:47.661955 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:47.815948 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:47.964041 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updated VIF entry in instance network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:07:47.964341 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:48.047632 np0000001388 nova-compute[98319]: DEBUG nova.compute.rpcapi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98319) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}}
May 26 05:07:48.062959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:48.063937 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:48.064125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:48.466285 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-10dca43b-f161-4ddb-bc9a-3ba0901daf7e req-ba97f3bc-342d-433f-bbaf-a3337811feb3 service nova] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:49.069040 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:49.142477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:07:49.142573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:07:49.142711 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:07:49.647665 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:49.819531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:49.886770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:49.890365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:49.987306 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:50.127858 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:50.394276 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:50.631654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:07:50.899555 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Ignoring supplied device name: /dev/vdb
May 26 05:07:51.145459 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:07:51.158277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:07:51.189218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:51.225857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:07:51.228605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:07:51.241230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:07:51.241230 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe95:f3f3', 'fe80::dc23:30ff:fe28:fa8a', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe14:7a24'] 
May 26 05:07:51.241230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:07:51.241230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:07:51.241752 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (95ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:51.403719 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:51.938422 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0009919389999595296 future=<Future at 0x7d7aa437a9c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:51.938422 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:51.938422 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.142837609999788 future=<Future at 0x7d7aa43c3b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:51.938422 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.142751419999968 future=<Future at 0x7d7aa43c3b00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:51.940459 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] Emitting event <LifecycleEvent: 1779772056.936718, e44fef6b-6d4c-49b1-977e-3d190c009d28 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:07:51.940459 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] VM Stopped (Lifecycle Event)
May 26 05:07:52.311059 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:52.410416 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Starting finish_migration {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12787}}
May 26 05:07:52.412638 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:07:52.412638 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Creating image(s)
May 26 05:07:52.413027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:52.445963 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-024edd75-d4ec-4692-b4b6-b71c6368213d tempest-VolumesActionsTest-419857946 tempest-VolumesActionsTest-419857946-project-member] [instance: e44fef6b-6d4c-49b1-977e-3d190c009d28] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:07:52.506714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:52.507112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:52.507458 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Attaching volume 7e6c45cb-6840-44e6-92b0-542a5fe58204 to /dev/vdb
May 26 05:07:52.574684 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:07:52.590750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:07:52.604756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.192s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:52.605513 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:07:52.605849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:52.634605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:52.683519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:07:52.683948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:07:52.693499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:07:52.695615 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe95:f3f3', 'fe80::dc23:30ff:fe28:fa8a', 'fe80::fc16:3eff:fea5:277f', 'fe80::2c42:7eff:feb2:c76d', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe14:7a24'] 
May 26 05:07:52.696691 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:07:52.696691 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:07:52.697431 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:52.697798 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating existing volume attachment record: d56d7777-5504-4919-81e3-3c43a4d37997 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:07:52.741258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:52.741258 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Cannot resize image /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:07:53.245560 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:07:53.246102 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Ensure instance console log exists: /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:07:53.246174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:53.246562 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:53.247013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:53.250709 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start _get_guest_xml network_info=[{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'b8146fab-2e1a-4066-ba1b-a2f33af33c80', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '7583fee2-acf9-4217-ad23-adca4ec3e186', 'attached_at': '2026-05-26T05:07:51.000000', 'detached_at': '', 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'multiattach': True, 'serial': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:07:53.255053 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:07:53.256874 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='7583fee2-acf9-4217-ad23-adca4ec3e186'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772073.256378) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:07:53.258888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:07:53.259346 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:07:53.260566 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:07:53.260925 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:07:53.262137 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:07:53.262569 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:07:53.262717 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:07:53.263042 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:07:53.263258 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:07:53.263486 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:07:53.263556 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:07:53.263761 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:07:53.263916 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:07:53.264234 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:07:53.264336 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:07:53.264490 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:07:53.281920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:07:53.309498 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:07:53.310442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:07:53.312217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:53.312217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:53.312217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:07:53.328230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:53.328950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:53.329540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:53.329860 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:07:53.330382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:53.330698 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:07:53.345265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:07:53.345265 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:53.352067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:07:53.352067 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:53.362345 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204] added
May 26 05:07:53.362345 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:07:53.362345 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:07:53.362345 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:07:53.362345 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:07:53.362345 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:07:53.362345 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:53.362645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:07:53.362751 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0329(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:07:53.362928 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:07:53.366987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204] added
May 26 05:07:53.366987 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:07:53.366987 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:07:53.366987 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:07:53.366987 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:07:53.366987 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:07:53.366987 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:53.367288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:07:53.367526 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0368(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:07:53.367748 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:07:53.383767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:07:53.384267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:53.384496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:53.385143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:53.385619 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:07:53.385966 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:07:53.386094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:54.363629 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:07:54.368229 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:07:54.379003 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:07:54.379003 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:07:54.387132 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:07:54.387132 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.396724 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.405387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.414628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.414628 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.414628 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.414628 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.414628 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.414628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:54.414973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.414973 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.414973 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.414973 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.414973 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.414973 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:54.424624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.424624 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.424624 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.424624 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.424624 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.424624 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:54.424917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.424917 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.424917 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.424917 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.424917 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.424917 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:54.457627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.40.100,3260]
May 26 05:07:54.457627 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.40.100,3260] successful.
May 26 05:07:54.457627 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.470209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.50.100,3260]
May 26 05:07:54.470209 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.50.100,3260] successful.
May 26 05:07:54.470209 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.475818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.485738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.499655 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.500054 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:54.500357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:54.500357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:07:54.501439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] HCTL ('8', '-', '-', 0) found on session 110 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:07:54.501584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.510558 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:54.510811 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:54.511792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:54.512721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:07:54.513530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] HCTL ('11', '-', '-', 0) found on session 111 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:07:54.513692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:07:54.528592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching for a device in session 110 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:07:54.542553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching for a device in session 111 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:07:54.542553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:07:54.824420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:55.529077 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching for a device in session 110 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:07:55.530040 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:07:56.220815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:56.220815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:56.220815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:56.220815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:56.220815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:56.225572 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Terminating instance
May 26 05:07:56.350029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found WWN 33000000047d8d031 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:07:56.350327 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.039s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:56.350518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '33000000047d8d031', 'path': '/dev/dm-0', 'multipath_id': '33000000047d8d031'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:56.350652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000047d8d031', 'path': '/dev/dm-0', 'multipath_id': '33000000047d8d031'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:07:56.353261 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:56.356035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.970s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:56.356279 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:07:56.373140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:56.373545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:56.373816 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:07:56.374568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:07:56.375457 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:07:56.375693 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:07:56.395140 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:07:56.395140 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:07:56.402310 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:07:56.402310 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:56.407584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:56.416538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.433877 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:56.438941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:56.438941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:07:56.438941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('9', '0', '0', 0) found on session 97 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:07:56.438941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 9 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.440406 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [109] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:07:56.440930 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.065s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:56.440930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:07:56.441762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('10', '0', '0', 0) found on session 98 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:07:56.441869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 10 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:07:56.448397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 97 and hctl ('9', '0', '0', 0) yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:07:56.448585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:07:56.451675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 98 and hctl ('10', '0', '0', 0) yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:07:56.452122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:07:56.728122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:07:56.751435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.753588 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.773567 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.777233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.795285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.800149 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:56.859270 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Attempting to attach volume 7e6c45cb-6840-44e6-92b0-542a5fe58204 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:07:56.863777 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:   <alias name="ua-7e6c45cb-6840-44e6-92b0-542a5fe58204"/>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:   <serial>7e6c45cb-6840-44e6-92b0-542a5fe58204</serial>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]: </disk>
May 26 05:07:56.863777 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:07:56.964218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:56.965824 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:56.965930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:56.966164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:56.966362 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:56.967019 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-23792035-ddde-461e-ab86-c5af54de9627 req-bb462ba5-5600-4366-ab89-3eb084d91245 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:07:57.183581 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999591857999803 future=<Future at 0x7d7aa4448950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:07:57.188094 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Instance destroyed successfully.
May 26 05:07:57.188637 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lazy-loading 'resources' on Instance uuid c6aa2167-8fa0-4795-9166-36d8a29c477a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:07:57.312945 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:57.376002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:07:57.693244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-97965079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumeshelvetestjson-server-97965079',id=38,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDPMxUQzoIudUsr7giSdmJtCmDmteNUA+Fv8w2zZXDygF4TeUGoF39pC/VETxTJVPT7Gg8Oa6aT9Z2V0kbJ9zZ3bKJ43KEBJKqg11cEMim1aeTo+q5MNnl8M0B2/qddPig==',key_name='tempest-keypair-1986219734',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:18Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6925a7d36eb4b919388468635037918',ramdisk_id='',reservation_id='r-2wm9oszo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-946543145',owner_user_name='tempest-AttachVolumeShelveTestJSON-946543145-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:07:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fdb1ab2deb1f45f3a5cb5374e0e8dea1',uuid=c6aa2167-8fa0-4795-9166-36d8a29c477a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:07:57.693592 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converting VIF {"id": "0504e6f4-659f-4a72-858a-d5dca4e68565", "address": "fa:16:3e:a5:27:7f", "network": {"id": "136011d5-206c-4431-972e-665b487df84a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-814187829-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b6925a7d36eb4b919388468635037918", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0504e6f4-65", "ovs_interfaceid": "0504e6f4-659f-4a72-858a-d5dca4e68565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:57.694492 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:57.694810 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:07:57.696484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:57.696811 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0504e6f4-65, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:57.700622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:57.704388 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:57.706525 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:57.706841 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83763bce-04af-44c8-8f6f-ec4adbb8101b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:57.710382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:57.714867 np0000001388 nova-compute[98319]: INFO os_vif [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:27:7f,bridge_name='br-int',has_traffic_filtering=True,id=0504e6f4-659f-4a72-858a-d5dca4e68565,network=Network(136011d5-206c-4431-972e-665b487df84a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0504e6f4-65')
May 26 05:07:57.715190 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Deleting instance files /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a_del
May 26 05:07:57.734538 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Deletion of /opt/stack/data/nova/instances/c6aa2167-8fa0-4795-9166-36d8a29c477a_del complete
May 26 05:07:58.240437 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Took 1.51 seconds to destroy the instance on the hypervisor.
May 26 05:07:58.240951 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:07:58.241163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:07:58.241302 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:07:58.241580 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:58.395763 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 33000000098d416b2 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:07:58.396079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:07:58.396328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (5010ms) {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:07:58.396499 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000098d416b2', 'path': '/dev/dm-1', 'multipath_id': '33000000098d416b2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:07:58.531737 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:07:58.580335 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:58.580502 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:58.580567 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:07:58.580693 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No VIF found with MAC fa:16:3e:95:f3:f3, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:07:58.902176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:07:58.902837 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:58.903296 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:58.905955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] End _get_guest_xml xml=<domain type="qemu">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <uuid>7583fee2-acf9-4217-ad23-adca4ec3e186</uuid>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <name>instance-00000027</name>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <memory>262144</memory>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:name>multiattach-server-1</nova:name>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:07:53</nova:creationTime>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.micro" id="84">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:memory>256</nova:memory>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         <nova:port uuid="a8308c82-1af4-4f92-9424-20cd5c165b63">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <system>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="serial">7583fee2-acf9-4217-ad23-adca4ec3e186</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="uuid">7583fee2-acf9-4217-ad23-adca4ec3e186</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </system>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <os>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </os>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <features>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </features>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   <devices>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk.config"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <shareable/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </disk>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:44:cc:e2"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <target dev="tapa8308c82-1a"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </interface>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/console.log" append="off"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </serial>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <video>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </video>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </rng>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:   </devices>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]: </domain>
May 26 05:07:58.905955 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:06:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000001388',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "vif_mac": "fa:16:3e:44:cc:e2"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:58.908732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:07:58.909957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.910223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f23a7f7-5141-5f2b-beec-2672eac29e3c', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:58.911468 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.912886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:58.917025 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.917454 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8308c82-1a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:58.917905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8308c82-1a, col_values=(('qos', UUID('6da2ba7b-53a9-4868-b5e9-95902451b2d4')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:58.918166 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8308c82-1a, col_values=(('external_ids', {'iface-id': 'a8308c82-1af4-4f92-9424-20cd5c165b63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:cc:e2', 'vm-uuid': '7583fee2-acf9-4217-ad23-adca4ec3e186'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:07:58.919717 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.921145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:07:58.929003 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:07:58.930258 np0000001388 nova-compute[98319]: INFO os_vif [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a')
May 26 05:07:59.031643 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:59.031804 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] Acquiring lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:07:59.031947 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:07:59.032074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:07:59.032208 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] No waiting events found dispatching network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:07:59.032331 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a667d12-b343-48d3-a09a-217b96c2315c req-1aca8746-d7b3-44aa-969e-b349617deb34 service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-unplugged-0504e6f4-659f-4a72-858a-d5dca4e68565 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:07:59.107747 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6c7d485a-9064-4c3b-b9db-d5c9e8a04e6f req-204acb9d-ede2-4bdd-9085-080f64d225ba service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Received event network-vif-deleted-0504e6f4-659f-4a72-858a-d5dca4e68565 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:07:59.109551 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-6c7d485a-9064-4c3b-b9db-d5c9e8a04e6f req-204acb9d-ede2-4bdd-9085-080f64d225ba service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Neutron deleted interface 0504e6f4-659f-4a72-858a-d5dca4e68565; detaching it from the instance and deleting it from the info cache
May 26 05:07:59.109746 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6c7d485a-9064-4c3b-b9db-d5c9e8a04e6f req-204acb9d-ede2-4bdd-9085-080f64d225ba service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:59.555561 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:07:59.613835 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6c7d485a-9064-4c3b-b9db-d5c9e8a04e6f req-204acb9d-ede2-4bdd-9085-080f64d225ba service nova] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Detach interface failed, port_id=0504e6f4-659f-4a72-858a-d5dca4e68565, reason: Instance c6aa2167-8fa0-4795-9166-36d8a29c477a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:08:00.057924 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Took 1.82 seconds to deallocate network for instance.
May 26 05:08:00.138803 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a113a445-f74a-4292-b108-31e1d94642ca tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.632s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:00.456259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:00.456712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:00.456712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:00.456712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:44:cc:e2, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:00.457466 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Using config drive
May 26 05:08:00.567732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:00.569118 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:00.937088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:00.964928 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:00.968461 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:01.080825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:01.081790 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005513060000339465 future=<Future at 0x7d7aa43c3b00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:01.081790 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:01.082770 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Emitting event <LifecycleEvent: 1779772066.0808315, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:01.082770 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=11.100895547000164 future=<Future at 0x7d7aa4448950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:01.082770 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=11.100761757999862 future=<Future at 0x7d7aa4448950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:01.083555 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Stopped (Lifecycle Event)
May 26 05:08:01.162147 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:01.162147 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:01.251630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:01.251912 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:01.260992 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:01.262453 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:01.262626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:01.262741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:01.262886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:01.263017 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-843aa13f-06f5-4b47-ac05-f58aa50ff56d req-a1895b3d-8c95-4a0e-95c9-981cfa6037a9 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received unexpected event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with vm_state active and task_state resize_finish.
May 26 05:08:01.588578 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8c1ed5f1-1081-4fe2-804a-ffe0ade9aa49 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:01.755395 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:01.940843 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772081.9404466, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:01.941501 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:08:01.942770 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Resumed (Lifecycle Event)
May 26 05:08:01.945426 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance running successfully.
May 26 05:08:01.946482 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Failed to set time: agent not configured {{(pid=98319) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}}
May 26 05:08:01.946696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a4ec0dd9-48f0-4668-ab62-545e678a5326 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] finish_migration finished successfully. {{(pid=98319) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12882}}
May 26 05:08:02.266081 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.697s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:02.314532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:02.335952 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Deleted allocations for instance c6aa2167-8fa0-4795-9166-36d8a29c477a
May 26 05:08:02.445689 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:02.447505 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:02.949738 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] During sync_power_state the instance has a pending task (resize_finish). Skip.
May 26 05:08:02.950024 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772082.9497807, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:02.952695 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Started (Lifecycle Event)
May 26 05:08:03.300712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:03.301097 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:03.301137 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Going to confirm migration 4 {{(pid=98319) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}}
May 26 05:08:03.348732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e65acb3-7a4c-4e1b-bf44-1334229ca12e tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Lock "c6aa2167-8fa0-4795-9166-36d8a29c477a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.130s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:03.365649 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:03.366353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:03.366753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:03.366837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:03.367045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:03.367232 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-2ae113c0-a2e5-4953-9f85-a6f3118ac9ee req-f06a88f4-fb25-471b-bddc-fa651d1064b5 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received unexpected event network-vif-plugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with vm_state resized and task_state None.
May 26 05:08:03.454956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:03.459602 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:03.808106 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:03.889476 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:03.926923 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:03.980697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:03.980842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:03.981333 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:03.981525 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'info_cache' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:04.987568 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:05.242538 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:05.374059 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:05.875936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:05.876097 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'migration_context' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:06.378965 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Object Instance<7583fee2-acf9-4217-ad23-adca4ec3e186> lazy-loaded attributes: info_cache,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:06.387935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:06.388863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:07.286739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:07.286995 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:07.316006 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:07.375140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:07.466340 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:07.537768 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:07.538034 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:07.793307 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Detaching volume 7e6c45cb-6840-44e6-92b0-542a5fe58204
May 26 05:08:07.864602 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Attempting to driver detach volume 7e6c45cb-6840-44e6-92b0-542a5fe58204 from mountpoint /dev/vdb
May 26 05:08:07.877214 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found disk vdb by alias ua-7e6c45cb-6840-44e6-92b0-542a5fe58204 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:07.883559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found disk vdb by alias ua-7e6c45cb-6840-44e6-92b0-542a5fe58204 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:07.883559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Attempting to detach device vdb from instance f7383e81-a647-4887-aa33-09977dd902bb from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:08:07.883559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <alias name="ua-7e6c45cb-6840-44e6-92b0-542a5fe58204"/>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <serial>7e6c45cb-6840-44e6-92b0-542a5fe58204</serial>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:07.883559 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:07.890706 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully detached device vdb from instance f7383e81-a647-4887-aa33-09977dd902bb from the persistent domain config.
May 26 05:08:07.891451 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] (1/8): Attempting to detach device vdb with device alias ua-7e6c45cb-6840-44e6-92b0-542a5fe58204 from instance f7383e81-a647-4887-aa33-09977dd902bb from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:08:07.891451 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <alias name="ua-7e6c45cb-6840-44e6-92b0-542a5fe58204"/>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <serial>7e6c45cb-6840-44e6-92b0-542a5fe58204</serial>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:07.891451 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:08.042365 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:08.487161 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772088.4866548, f7383e81-a647-4887-aa33-09977dd902bb => ua-7e6c45cb-6840-44e6-92b0-542a5fe58204> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:08:08.492063 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7e6c45cb-6840-44e6-92b0-542a5fe58204 for instance f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:08:08.497732 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully detached device vdb from instance f7383e81-a647-4887-aa33-09977dd902bb from the live domain config.
May 26 05:08:08.498762 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:08:08.499099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:08.499311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:08.499733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:08.500052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:08:08.500217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:08.537564 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [110] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [111] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204 (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:08.537984 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', '110'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', '111'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:08:08.537984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', '110')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:08.539230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', '111')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:08.539986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f3a60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:08:08.540238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:08:08.540463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flush multipath device 33000000047d8d031 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:08:08.588997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:08:08.643026 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:08:08.694786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:08:08.694980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:08:08.696212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:08:08.711787 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:08:08.711932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:08:08.725812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.764773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 110, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.40.100,3260]
May 26 05:08:08.764773 np0000001388 nova-compute[98319]: Logout of [sid: 110, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.40.100,3260] successful.
May 26 05:08:08.764773 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.785742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.800596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.841128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 111, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.50.100,3260]
May 26 05:08:08.841128 np0000001388 nova-compute[98319]: Logout of [sid: 111, target: iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, portal: 192.168.50.100,3260] successful.
May 26 05:08:08.841128 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.856551 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:08.856804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:08.856968 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== disconnect_volume: return (357ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:08.857168 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:08:08.928297 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:09.057232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 2.669s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:09.411963 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:09.731615 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocation for migration 0ab5ba5d-7865-4c21-bdb4-55376e001d72
May 26 05:08:10.237168 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b9be931f-624b-4ba7-86eb-31a0f54606c8 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 6.936s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:10.423431 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58ce75dd-4ff3-4d95-bf4f-7d70ac9fd8c6 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:10.424554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 3.049s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:10.424969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:10.425110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:10.425386 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:10.428279 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Terminating instance
May 26 05:08:10.593133 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:10.593347 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing instance network info cache due to event network-changed-f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:10.593513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] Acquiring lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:10.593632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] Acquired lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:10.594156 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Refreshing network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:10.933980 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:08:10.957495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:10.961208 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:10.986674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:10.988924 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.018653 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.019408 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.097667 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:11.195386 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:11.198226 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:11.198762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:11.198918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:11.199080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] No waiting events found dispatching network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:11.199230 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77aac7be-22af-4c59-80b4-659c28722d08 req-f5d9948f-26eb-4627-913a-17639c0522cb service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:08:11.295419 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999677898999835 future=<Future at 0x7d7ac43c8380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:11.298082 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Instance destroyed successfully.
May 26 05:08:11.298637 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'resources' on Instance uuid f7383e81-a647-4887-aa33-09977dd902bb {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:11.524404 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:11.684591 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updated VIF entry in instance network info cache for port f0f7ac1e-f1fb-4712-80af-906a91796719. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:11.684890 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [{"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:11.801007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:06:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-497066655',display_name='tempest-VolumesSnapshotTestJSON-instance-497066655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-497066655',id=42,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNT0371lrzIYTg9eTOSgenpY0T6pCypEly6aEuPBA1U+Dwn8pEefGqKSdwjq4SzckGE0Y2X/rR0sU3n7Qg00SdHGfaYoTU8/2tImL/J4W5h6/PfvoyXQZR6XonwlPVApg==',key_name='tempest-keypair-506566655',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:12Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-jr0kvwad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:07:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=f7383e81-a647-4887-aa33-09977dd902bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:08:11.801282 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "address": "fa:16:3e:95:f3:f3", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfad2e7c-9a", "ovs_interfaceid": "bfad2e7c-9ae2-4ec7-976d-90faac916b69", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:11.801624 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:11.801812 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:08:11.802961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.803772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfad2e7c-9a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:11.817429 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.819590 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:11.820436 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.820636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5512afc3-e843-49b6-82da-b1e497f7d0d3) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:11.821860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:11.822324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:11.824801 np0000001388 nova-compute[98319]: INFO os_vif [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:f3:f3,bridge_name='br-int',has_traffic_filtering=True,id=bfad2e7c-9ae2-4ec7-976d-90faac916b69,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfad2e7c-9a')
May 26 05:08:11.826101 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:08:11.826472 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:11.826930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:11.827131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:11.827513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7e6c45cb-6840-44e6-92b0-542a5fe58204', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:08:11.827710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:08:11.851397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:11.851397 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:11.851397 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:11.851397 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:11.851397 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:11.851397 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:11.851724 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [112] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:11.851724 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:11.851724 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:11.851724 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:11.851724 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:11.851724 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:11.852082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7', '112'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:08:11.852310 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:11.852517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:08:11.852688 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:11.852915 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7e6c45cb-6840-44e6-92b0-542a5fe58204') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:08:11.853090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4378a40>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:08:11.853282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:08:11.853548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.026s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:11.853714 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== disconnect_volume: return (27ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:11.853886 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:08:11.854265 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Deleting instance files /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb_del
May 26 05:08:11.855190 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Deletion of /opt/stack/data/nova/instances/f7383e81-a647-4887-aa33-09977dd902bb_del complete
May 26 05:08:12.185714 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0025666739998086996 future=<Future at 0x7d7aa4448950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:12.186314 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772077.1830475, c6aa2167-8fa0-4795-9166-36d8a29c477a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:12.186488 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] VM Stopped (Lifecycle Event)
May 26 05:08:12.191340 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:12.198931 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-345e83e1-0c6b-4269-9a09-089a3a020bd2 req-19b59a45-0818-4388-af26-014792b3c10d service nova] Releasing lock "refresh_cache-67e6c789-cd47-4a9d-85a4-3c51faa4d646" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:12.198931 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.101157831999899 future=<Future at 0x7d7ac43c8380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:12.198931 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.100952377999874 future=<Future at 0x7d7ac43c8380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:12.270825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:12.318079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:12.361661 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Took 1.43 seconds to destroy the instance on the hypervisor.
May 26 05:08:12.362300 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:08:12.362631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:08:12.362719 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:08:12.362915 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:12.439339 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:12.674619 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:12.674736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing instance network info cache due to event network-changed-a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:12.674921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] Acquiring lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:12.675943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] Acquired lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:12.675943 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Refreshing network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:12.699392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6aa2167-8fa0-4795-9166-36d8a29c477a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:13.167227 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5ccc4dfe-78b5-4786-b63d-c570d69857e9 req-b11e824c-2535-4892-9b50-8b78c6a06505 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-deleted-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:13.167227 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5ccc4dfe-78b5-4786-b63d-c570d69857e9 req-b11e824c-2535-4892-9b50-8b78c6a06505 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Neutron deleted interface bfad2e7c-9ae2-4ec7-976d-90faac916b69; detaching it from the instance and deleting it from the info cache
May 26 05:08:13.167227 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5ccc4dfe-78b5-4786-b63d-c570d69857e9 req-b11e824c-2535-4892-9b50-8b78c6a06505 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:13.180703 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:13.299689 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:13.300157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] Acquiring lock "f7383e81-a647-4887-aa33-09977dd902bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:13.300244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:13.300412 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] Lock "f7383e81-a647-4887-aa33-09977dd902bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:13.300583 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] No waiting events found dispatching network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:13.300748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ababa368-b82e-47a0-904c-bc03181bdbef req-107005f5-0566-40e4-82b7-c181a52b249e service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Received event network-vif-unplugged-bfad2e7c-9ae2-4ec7-976d-90faac916b69 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:08:13.481218 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:13.674795 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:13.678679 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5ccc4dfe-78b5-4786-b63d-c570d69857e9 req-b11e824c-2535-4892-9b50-8b78c6a06505 service nova] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Detach interface failed, port_id=bfad2e7c-9ae2-4ec7-976d-90faac916b69, reason: Instance f7383e81-a647-4887-aa33-09977dd902bb could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:08:13.856448 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updated VIF entry in instance network info cache for port a8308c82-1af4-4f92-9424-20cd5c165b63. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:13.856773 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [{"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:13.983154 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Took 1.62 seconds to deallocate network for instance.
May 26 05:08:14.013454 np0000001388 nova-compute[98319]: WARNING nova.volume.cinder [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Attachment d56d7777-5504-4919-81e3-3c43a4d37997 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d56d7777-5504-4919-81e3-3c43a4d37997. (HTTP 404) (Request-ID: req-1959c4ff-66b8-4966-bb27-1efcdb71b383)
May 26 05:08:14.014093 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Took 0.03 seconds to detach 1 volumes for instance.
May 26 05:08:14.359288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005a99a8-ac30-4e1b-8bb4-5b0e9fd76466 req-a1e46f3c-0370-49f5-b25d-e8443ea630bf service nova] Releasing lock "refresh_cache-7583fee2-acf9-4217-ad23-adca4ec3e186" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:14.523710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:14.523862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:14.529104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:15.105117 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:15.105117 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:15.607481 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:16.113612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.589s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:16.191516 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Deleted allocations for instance f7383e81-a647-4887-aa33-09977dd902bb
May 26 05:08:16.821445 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:17.201053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-65ba106e-f38a-4503-8d1d-0421af9cb582 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "f7383e81-a647-4887-aa33-09977dd902bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.777s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:17.323972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:17.824289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:17.824787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:18.326510 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:08:18.900184 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:18.900685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:18.905009 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:08:18.905337 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Claim successful on node np0000001388
May 26 05:08:20.606235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:20.606235 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:21.109219 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:21.616090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.716s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:21.616644 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:08:21.823008 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:22.122883 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:08:22.123278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:08:22.123546 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:22.123832 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:22.163524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:22.192579 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5137ef274a4a94a48962027c45d899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23047976f3814538912524932a6a9375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:08:22.332772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:22.605676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:22.606085 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:22.626438 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:08:22.698002 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Successfully created port: 371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:08:23.110447 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'flavor' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:23.131534 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:08:23.184691 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Successfully updated port: 371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:08:23.233703 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-changed-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:23.233888 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Refreshing instance network info cache due to event network-changed-371911ea-95e3-4421-a4b5-e7e477cf0ef3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:23.233950 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] Acquiring lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:23.234048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] Acquired lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:23.234163 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Refreshing network info cache for port 371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:23.686771 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:23.700501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:23.736306 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:23.789573 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:23.913102 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:24.115577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:24.140023 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:08:24.141283 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:08:24.141438 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Creating image(s)
May 26 05:08:24.141798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:24.142003 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:24.142358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:24.142809 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:24.147056 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:24.148332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:24.254557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:24.255056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:24.255654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:24.256118 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:24.258722 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:24.259016 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:24.355429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:24.357421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:24.407705 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk 1073741824" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:24.408389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:24.408863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:24.426313 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81d01120-96d5-4beb-ae19-0b8a9ed17d43 req-dcb39866-54d3-4eb1-b528-7b41df9541f0 service nova] Releasing lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:24.427716 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquired lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:24.428000 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:24.501725 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:24.502230 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:08:24.509852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:24.510306 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:08:24.510665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:24.616681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:24.617258 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Cannot resize image /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:08:24.617765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:08:24.618004 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Ensure instance console log exists: /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:08:24.618338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:24.618564 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:24.618697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:25.000424 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:25.149489 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:25.175998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:25.175998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:25.176219 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attaching volume 3b576f1e-7833-4ab1-b6cd-32e301debab8 to /dev/vdb
May 26 05:08:25.213209 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:25.224459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:08:25.245416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:25.279252 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating instance_info_cache with network_info: [{"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:25.290234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:08:25.290360 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:08:25.298089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:08:25.299242 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe14:7a24', 'fe80::fc16:3eff:fe44:cce2'] 
May 26 05:08:25.299357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:08:25.299442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:08:25.299636 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:25.299858 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating existing volume attachment record: 0de8538b-7ae8-4c74-8f52-330dcdb4825d {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:08:25.334107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:25.334640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:25.415927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:25.416405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:25.416561 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:25.416697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:25.417007 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] No waiting events found dispatching network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:25.417007 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-4b790747-33e5-42f5-b11f-73043797df11 req-30a7e9fc-a733-4a84-a0fa-efcf11636236 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received unexpected event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 for instance with vm_state building and task_state spawning.
May 26 05:08:25.782923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Releasing lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:25.783213 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance network_info: |[{"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:08:25.785106 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Start _get_guest_xml network_info=[{"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:08:25.788474 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:25.789870 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-964296347', uuid='013b0bd1-140e-45dc-a5fa-73f702d59332'), owner=OwnerMeta(userid='3a5137ef274a4a94a48962027c45d899', username='tempest-AttachVolumeNegativeTest-1739279332-project-member', projectid='23047976f3814538912524932a6a9375', projectname='tempest-AttachVolumeNegativeTest-1739279332'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772105.789332) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:08:25.791571 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:08:25.791930 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:08:25.792967 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:08:25.793178 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:08:25.794222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:08:25.794649 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:08:25.794848 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:08:25.794980 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:08:25.795175 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:08:25.795303 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:08:25.795406 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:08:25.795592 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:08:25.795692 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:08:25.795797 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:08:25.795902 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:08:25.796045 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:08:25.807249 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-964296347',display_name='tempest-AttachVolumeNegativeTest-server-964296347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-964296347',id=44,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnfMYJTGm0M8SPhQ9GlggTcEf1zfygRibRGcAOVrZwNN5JvdPGv/LYqgm2WmrCVqZ3url7+6ePe97PDy218y0hNMcKwBMG/Kj7fkI2LLmOaE5oTmN+cWgReaLwC8+HPJg==',key_name='tempest-keypair-901492531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-eddkms83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=013b0bd1-140e-45dc-a5fa-73f702d59332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:08:25.807457 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:25.807973 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:25.808576 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'pci_devices' on Instance uuid 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:25.836795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:08:25.865227 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:08:25.865227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:25.865227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:25.865227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:25.865227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:08:25.879070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:25.879736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:25.880438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:25.880950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:25.881267 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:25.881542 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:25.895909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:25.895909 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:25.896719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:25.896719 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:25.910961 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8] added
May 26 05:08:25.910961 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:25.910961 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:25.910961 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:25.910961 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:25.910961 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:25.910961 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:25.911273 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:25.911485 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0306(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:25.911687 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:25.915654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8] added
May 26 05:08:25.915654 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:25.915654 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:25.915654 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:25.915654 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:25.915654 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:25.915654 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:25.915931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:25.915931 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0347(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:25.916031 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:26.295508 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004214200002934376 future=<Future at 0x7d7ac43c8380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:26.295834 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:26.296417 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] Emitting event <LifecycleEvent: 1779772091.2949927, f7383e81-a647-4887-aa33-09977dd902bb => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:26.296590 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] VM Stopped (Lifecycle Event)
May 26 05:08:26.312504 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] End _get_guest_xml xml=<domain type="qemu">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <uuid>013b0bd1-140e-45dc-a5fa-73f702d59332</uuid>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <name>instance-0000002c</name>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-964296347</nova:name>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:08:25</nova:creationTime>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:user uuid="3a5137ef274a4a94a48962027c45d899">tempest-AttachVolumeNegativeTest-1739279332-project-member</nova:user>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:project uuid="23047976f3814538912524932a6a9375">tempest-AttachVolumeNegativeTest-1739279332</nova:project>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         <nova:port uuid="371911ea-95e3-4421-a4b5-e7e477cf0ef3">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <system>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="serial">013b0bd1-140e-45dc-a5fa-73f702d59332</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="uuid">013b0bd1-140e-45dc-a5fa-73f702d59332</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </system>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <os>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </os>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <features>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </features>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   <devices>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.config"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:39:fd:ac"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <target dev="tap371911ea-95"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </interface>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/console.log" append="off"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </serial>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <video>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </video>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </rng>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:   </devices>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]: </domain>
May 26 05:08:26.312504 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Preparing to wait for external event network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-964296347',display_name='tempest-AttachVolumeNegativeTest-server-964296347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-964296347',id=44,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnfMYJTGm0M8SPhQ9GlggTcEf1zfygRibRGcAOVrZwNN5JvdPGv/LYqgm2WmrCVqZ3url7+6ePe97PDy218y0hNMcKwBMG/Kj7fkI2LLmOaE5oTmN+cWgReaLwC8+HPJg==',key_name='tempest-keypair-901492531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-eddkms83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=013b0bd1-140e-45dc-a5fa-73f702d59332,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:08:26.314282 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:26.314541 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:26.315234 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:08:26.315234 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.315574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:26.316222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:08:26.317219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.317423 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8d31a79b-0b2b-5bed-a55b-6a56bcbb8341', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:26.318286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.319101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:26.344185 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.347188 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.347421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap371911ea-95, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:26.347873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap371911ea-95, col_values=(('qos', UUID('e7e21a9e-ee19-47a0-b799-68151e0915a0')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:26.348053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap371911ea-95, col_values=(('external_ids', {'iface-id': '371911ea-95e3-4421-a4b5-e7e477cf0ef3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:fd:ac', 'vm-uuid': '013b0bd1-140e-45dc-a5fa-73f702d59332'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:26.351835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.354434 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:26.355485 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:26.357095 np0000001388 nova-compute[98319]: INFO os_vif [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95')
May 26 05:08:26.410841 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:26.411087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:26.414520 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:08:26.414846 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Claim successful on node np0000001388
May 26 05:08:26.618609 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:26.618985 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:26.619235 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:26.619491 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:08:26.799985 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c384878b-8e50-4440-abf0-f42c752d4ec6 tempest-AttachVolumeShelveTestJSON-946543145 tempest-AttachVolumeShelveTestJSON-946543145-project-member] [instance: f7383e81-a647-4887-aa33-09977dd902bb] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:26.912121 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:26.917029 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:26.926538 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:26.926538 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:26.933766 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:26.933766 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:26.941495 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:26.947304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.957351 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:26.963692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:26.963692 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.963692 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.963692 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.963692 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.963692 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:26.963896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:26.963896 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.963896 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:26.963896 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.963896 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:26.963896 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:27.003770 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.40.100,3260]
May 26 05:08:27.003770 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.40.100,3260] successful.
May 26 05:08:27.003770 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:27.013046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.50.100,3260]
May 26 05:08:27.013046 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.50.100,3260] successful.
May 26 05:08:27.013046 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:27.017838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:27.024376 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.036487 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] HCTL ('8', '-', '-', 0) found on session 114 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:27.036487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsi session list stdout=tcp: [113] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:27.042238 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.160s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] HCTL ('11', '-', '-', 0) found on session 115 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:27.042238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:27.070296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching for a device in session 114 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:27.070296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching for a device in session 115 and hctl ['11', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:27.334227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:27.879116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:27.880636 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:27.880837 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:39:fd:ac, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:27.881389 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Using config drive
May 26 05:08:27.921989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:27.922220 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:28.059142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching for a device in session 114 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:28.059375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:28.064554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching for a device in session 115 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:28.064678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:28.388371 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:28.426769 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:28.593753 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:28.617676 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:28.618304 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:28.618578 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:28.675038 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Creating config drive at /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.config
May 26 05:08:28.679107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmnwwcthe {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:28.733325 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmnwwcthe" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:28.883221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:08:28.942662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.531s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:28.943401 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:08:29.125805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:29.126090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:29.126332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:29.126535 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:08:29.345650 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.375327 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.456335 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:08:29.458763 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:08:29.458763 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:29.462398 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:29.486272 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.569040 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e5c64df40bd44d89d8f1617f4fa5281', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59c0c90d3ca84a4bb5aaf3f1c8245e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:08:29.771352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.773509 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.776778 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.799028 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.800695 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:29.901272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Found WWN 3300000009a63321e for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:08:29.902279 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:29.902673 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] <== connect_volume: return (4038ms) {'type': 'block', 'scsi_wwn': '3300000009a63321e', 'path': '/dev/dm-0', 'multipath_id': '3300000009a63321e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:29.902914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009a63321e', 'path': '/dev/dm-0', 'multipath_id': '3300000009a63321e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:08:29.907066 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'flavor' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:29.969804 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:08:30.172914 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Successfully created port: 8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:08:30.349126 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772110.3487473, 013b0bd1-140e-45dc-a5fa-73f702d59332 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:30.349289 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] VM Started (Lifecycle Event)
May 26 05:08:30.411938 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attempting to attach volume 3b576f1e-7833-4ab1-b6cd-32e301debab8 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:08:30.413471 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:   <alias name="ua-3b576f1e-7833-4ab1-b6cd-32e301debab8"/>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:   <serial>3b576f1e-7833-4ab1-b6cd-32e301debab8</serial>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:30.413471 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:08:30.475065 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:08:30.616131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:30.732952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:30.737547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:30.807262 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Successfully updated port: 8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:08:30.836511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:30.839593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:30.856131 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:30.864589 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772110.8639555, 013b0bd1-140e-45dc-a5fa-73f702d59332 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:30.865038 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] VM Paused (Lifecycle Event)
May 26 05:08:30.875766 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-changed-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:30.879324 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Refreshing instance network info cache due to event network-changed-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:30.879324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] Acquiring lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:30.879324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] Acquired lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:30.879324 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Refreshing network info cache for port 8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:30.961571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:30.961975 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.057612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.070554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.167369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.167916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.188945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:31.191052 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:31.264474 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.264956 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:08:31.268806 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.312026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:31.348973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:31.358906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.359504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.377973 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:31.384486 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:31.397052 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:31.468919 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:31.471436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.474655 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:08:31.476727 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.506961 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:08:31.510267 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:08:31.510605 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Creating image(s)
May 26 05:08:31.511942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:31.512520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:31.513400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:31.514340 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:31.517806 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:31.519848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.580770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.581194 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.629542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.630101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:31.636001 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.006s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:31.636837 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:31.641180 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:31.645051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.690970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.694612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.707879 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Detaching volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:08:31.734070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.734837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.769239 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:31.772833 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Attempting to driver detach volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 from mountpoint /dev/vdb
May 26 05:08:31.779384 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:31.781211 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:31.781392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Attempting to detach device vdb from instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:08:31.781841 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:31.781841 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:31.788527 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 from the persistent domain config.
May 26 05:08:31.788730 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] (1/8): Attempting to detach device vdb with device alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 from instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:08:31.789052 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:31.789052 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:31.792536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.792536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:31.793141 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.809266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.809266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.896875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.900217 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:08:31.900217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:31.913314 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:08:31.917798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:31.920225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.003577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Cannot resize image /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Ensure instance console log exists: /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:32.007321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:32.035946 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49e53157-f968-4cec-a845-5556714f79cd req-36c2c818-59e6-4a48-bae6-9aa6d026c45e service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:32.036583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49e53157-f968-4cec-a845-5556714f79cd req-36c2c818-59e6-4a48-bae6-9aa6d026c45e service nova] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:32.036811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49e53157-f968-4cec-a845-5556714f79cd req-36c2c818-59e6-4a48-bae6-9aa6d026c45e service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:32.036952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49e53157-f968-4cec-a845-5556714f79cd req-36c2c818-59e6-4a48-bae6-9aa6d026c45e service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:32.037118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49e53157-f968-4cec-a845-5556714f79cd req-36c2c818-59e6-4a48-bae6-9aa6d026c45e service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Processing event network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:08:32.037839 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:08:32.038864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.038864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.060294 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772112.0590878, 013b0bd1-140e-45dc-a5fa-73f702d59332 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:32.060685 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] VM Resumed (Lifecycle Event)
May 26 05:08:32.067217 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:08:32.073344 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance spawned successfully.
May 26 05:08:32.073867 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:08:32.103246 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:32.105274 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:32.105274 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:32.105274 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:14:7a:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:32.129764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.133329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.243094 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.247291 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.276400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28f5a568-f23c-49a2-82c6-cccd7de6322f req-add65ee4-0be1-4a9d-8a49-57f482260a16 service nova] Releasing lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:32.278100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquired lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:32.278362 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:32.337649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:32.364252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.364998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:08:32.370217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.435612 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 for instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:08:32.474319 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.477375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.568128 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:32.571900 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:32.582652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.582861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.583184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.583574 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.583816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.584146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:32.588849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.590041 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:08:32.595289 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:32.595289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:32.643808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:32.644119 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=11386MB free_disk=72.80048370361328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:08:32.644288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:32.644537 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:32.870849 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:33.034298 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:33.076469 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:08:33.076616 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772113.0762212, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:08:33.088428 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 from the live domain config.
May 26 05:08:33.090345 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Took 8.95 seconds to spawn the instance on the hypervisor.
May 26 05:08:33.090715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:33.210082 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updating instance_info_cache with network_info: [{"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:33.603650 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Took 14.77 seconds to build instance.
May 26 05:08:33.624917 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:33.625729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:33.643774 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Detected multiple connections on this host for volume: 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, skipping target disconnect.
May 26 05:08:33.692125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b5c6e576-e04d-4e9f-942d-a73e7738863b tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.516s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:33.712764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Releasing lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:33.713052 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance network_info: |[{"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:08:33.714778 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Start _get_guest_xml network_info=[{"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:08:33.717652 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:33.720977 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.721527 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesSnapshotTestJSON-instance-121177492', uuid='c6482b32-d458-4461-81de-fce59c1732fd'), owner=OwnerMeta(userid='0e5c64df40bd44d89d8f1617f4fa5281', username='tempest-VolumesSnapshotTestJSON-805170533-project-member', projectid='59c0c90d3ca84a4bb5aaf3f1c8245e23', projectname='tempest-VolumesSnapshotTestJSON-805170533'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772113.7206032) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a921deec-f5fe-4c81-a5c2-df30f947a826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance debb889d-e74c-4caa-b278-826a5ed536e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 258b4ab0-7d70-4714-b0a8-a1827592acad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance b71f2db5-8f92-4400-bf45-634f9790fca0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7583fee2-acf9-4217-ad23-adca4ec3e186 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 013b0bd1-140e-45dc-a5fa-73f702d59332 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.723640 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c6482b32-d458-4461-81de-fce59c1732fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:08:33.724318 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:08:33.725250 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:08:33.726095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:08:33.726360 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:08:33.727406 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:08:33.727799 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:08:33.727975 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:08:33.728096 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:08:33.728277 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:08:33.728391 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:08:33.728510 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:08:33.728694 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:08:33.729749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:08:33.729749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:08:33.729749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:08:33.729749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:08:33.744220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121177492',display_name='tempest-VolumesSnapshotTestJSON-instance-121177492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-121177492',id=45,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCWY7pgVnBIAJVFwXn6cnmoldZCcOjb4fhqLeAEAfwa414k2J8efAd4uVw0j9ZB/DnAd+I3cOYGb0uEGcae1BWlxxr7RNtWcUkM/sNuHK8TKyvqYzHuBxm9VJNNA0cG4w==',key_name='tempest-keypair-1318343605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-39tb5gvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=c6482b32-d458-4461-81de-fce59c1732fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:08:33.744486 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:33.745639 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:33.745735 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'pci_devices' on Instance uuid c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:34.091568 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:34.094422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:34.094579 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:34.094706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:34.094817 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] No waiting events found dispatching network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:34.094929 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received unexpected event network-vif-plugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 for instance with vm_state active and task_state None.
May 26 05:08:34.095018 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:34.095129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:34.095279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:34.095529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:34.095633 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] No waiting events found dispatching network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:34.096564 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6fd7da14-564f-49a0-85d6-9c4d191874a4 req-0af2d603-681f-47be-9dd0-b3b0c685d2a2 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received unexpected event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be for instance with vm_state building and task_state spawning.
May 26 05:08:34.105188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7e7ef1ba-33b2-492c-92c0-6f57dd251743 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.281s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:34.127384 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:08:34.177632 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Rescuing
May 26 05:08:34.177749 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:34.177856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:34.177985 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:34.196481 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:34.228220 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c390c1f4-d1aa-446a-93c7-43417d742588 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}}
May 26 05:08:34.228220 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:08:34.228220 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2560MB phys_disk=95GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:08:32 up 40 min,  2 users,  load average: 6.24, 7.01, 4.63\n', 'num_instances': '10', 'num_vm_active': '7', 'num_task_None': '8', 'num_os_type_None': '10', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '5', 'io_workload': '2', 'num_proj_68b22c1abf2f4ba788005f454c7f8add': '3', 'num_vm_rescued': '1', 'num_vm_building': '2', 'num_task_spawning': '2', 'num_proj_23047976f3814538912524932a6a9375': '1', 'num_proj_59c0c90d3ca84a4bb5aaf3f1c8245e23': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:08:34.248110 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] End _get_guest_xml xml=<domain type="qemu">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <uuid>c6482b32-d458-4461-81de-fce59c1732fd</uuid>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <name>instance-0000002d</name>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-121177492</nova:name>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:08:33</nova:creationTime>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:user uuid="0e5c64df40bd44d89d8f1617f4fa5281">tempest-VolumesSnapshotTestJSON-805170533-project-member</nova:user>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:project uuid="59c0c90d3ca84a4bb5aaf3f1c8245e23">tempest-VolumesSnapshotTestJSON-805170533</nova:project>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         <nova:port uuid="8226de6f-ae4b-43c9-9d6a-6d0388a2e3be">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <system>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="serial">c6482b32-d458-4461-81de-fce59c1732fd</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="uuid">c6482b32-d458-4461-81de-fce59c1732fd</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </system>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <os>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </os>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <features>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </features>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   <devices>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.config"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:e8:89:65"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <target dev="tap8226de6f-ae"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </interface>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/console.log" append="off"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </serial>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <video>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </video>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </rng>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:   </devices>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]: </domain>
May 26 05:08:34.248110 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Preparing to wait for external event network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121177492',display_name='tempest-VolumesSnapshotTestJSON-instance-121177492',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-121177492',id=45,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCWY7pgVnBIAJVFwXn6cnmoldZCcOjb4fhqLeAEAfwa414k2J8efAd4uVw0j9ZB/DnAd+I3cOYGb0uEGcae1BWlxxr7RNtWcUkM/sNuHK8TKyvqYzHuBxm9VJNNA0cG4w==',key_name='tempest-keypair-1318343605',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-39tb5gvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=c6482b32-d458-4461-81de-fce59c1732fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:34.250259 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:08:34.250660 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.253220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:34.253220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:08:34.253220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.253220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '88389a78-e143-55f6-82e9-d656c9118287', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:34.253734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.254568 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.256820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.257034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8226de6f-ae, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:34.257470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8226de6f-ae, col_values=(('qos', UUID('b087d1a7-08b9-4d1a-9fc5-b8600b972708')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:34.257672 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8226de6f-ae, col_values=(('external_ids', {'iface-id': '8226de6f-ae4b-43c9-9d6a-6d0388a2e3be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:89:65', 'vm-uuid': 'c6482b32-d458-4461-81de-fce59c1732fd'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:34.258476 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.259947 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:34.266065 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:34.267010 np0000001388 nova-compute[98319]: INFO os_vif [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae')
May 26 05:08:34.678563 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:34.681714 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:34.759288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:34.759525 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:35.057227 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:35.207881 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:35.208811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-150176f2-d4b6-4899-8417-e7eb7178cccc tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.018s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:35.263032 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:35.588280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:35.588482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:35.710294 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:35.769033 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:08:35.769175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.125s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:35.769451 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:08:35.770224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.092s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:35.774217 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:08:35.774217 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Claim successful on node np0000001388
May 26 05:08:35.792953 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:35.793077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:35.793191 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No VIF found with MAC fa:16:3e:e8:89:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:35.793599 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Using config drive
May 26 05:08:36.090947 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Detaching volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23
May 26 05:08:36.150639 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Attempting to driver detach volume 3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 from mountpoint /dev/vdb
May 26 05:08:36.159493 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-changed-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:36.160956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Refreshing instance network info cache due to event network-changed-371911ea-95e3-4421-a4b5-e7e477cf0ef3. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:36.162057 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] Acquiring lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:36.162237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] Acquired lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:36.162563 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:36.163588 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Refreshing network info cache for port 371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:36.170025 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found disk vdb by alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:08:36.170168 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Attempting to detach device vdb from instance 7583fee2-acf9-4217-ad23-adca4ec3e186 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:08:36.170469 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:36.170469 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:36.177096 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 7583fee2-acf9-4217-ad23-adca4ec3e186 from the persistent domain config.
May 26 05:08:36.177263 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] (1/8): Attempting to detach device vdb with device alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 from instance 7583fee2-acf9-4217-ad23-adca4ec3e186 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:08:36.177808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <alias name="ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23"/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <serial>3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23</serial>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]: </disk>
May 26 05:08:36.177808 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:08:36.300124 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:36.447389 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Creating config drive at /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.config
May 26 05:08:36.452066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo1_tes6o {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:36.560658 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo1_tes6o" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:36.673283 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:36.770124 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:08:36.770591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:08:36.772171 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.73 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:08:37.080808 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.123440 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.123648 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:37.129484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.235144 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.345128 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.381305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.445160 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updated VIF entry in instance network info cache for port 371911ea-95e3-4421-a4b5-e7e477cf0ef3. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:37.445804 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating instance_info_cache with network_info: [{"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:37.548744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.556603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.561039 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.576032 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:37.576276 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:37.601331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.605215 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.654466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.656541 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:37.658792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:37.659948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:37.660183 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:37.660787 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:37.661245 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8c221025-435f-4e61-9411-447126de9f1b req-41538083-0924-4d32-9119-b85b196dc21b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state active and task_state rescuing.
May 26 05:08:37.664014 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.685718 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999638344999767 future=<Future at 0x7d7aa437ee10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:37.687313 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998280889999933 future=<Future at 0x7d7aa437ee10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:37.687313 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998109188999933 future=<Future at 0x7d7aa437ee10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:37.690344 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance destroyed successfully.
May 26 05:08:37.690344 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'numa_topology' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:37.917769 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.923946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:37.950832 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a4f318ac-ef07-44c1-a809-68697a622f04 req-736320f2-400a-4e54-b4e3-5a436f2484d9 service nova] Releasing lock "refresh_cache-013b0bd1-140e-45dc-a5fa-73f702d59332" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:38.081234 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:38.134505 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772118.1339645, c6482b32-d458-4461-81de-fce59c1732fd => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:38.134650 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] VM Started (Lifecycle Event)
May 26 05:08:38.195695 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attempting rescue
May 26 05:08:38.196552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98319) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4650}}
May 26 05:08:38.203134 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance directory exists: not creating {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5211}}
May 26 05:08:38.203358 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Creating image(s)
May 26 05:08:38.204226 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:38.204442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:38.205033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:38.205296 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'trusted_certs' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:38.234722 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:38.234722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:38.234722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:38.234829 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:38.234940 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Processing event network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:08:38.240879 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:38.241508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:38.243045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:08:38.243316 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:38.243529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:38.244101 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] No waiting events found dispatching network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:38.244461 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-9dee3d16-f974-405e-b810-7d265e2f0cec req-0dac1383-bb8f-4320-8cb2-d66d7c166d57 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received unexpected event network-vif-plugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be for instance with vm_state building and task_state spawning.
May 26 05:08:38.247508 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:08:38.251050 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance spawned successfully.
May 26 05:08:38.251425 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:08:38.587711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.818s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:38.588049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:08:38.638314 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:38.641750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:38.710090 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:38.710090 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:38.712298 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:38.713496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:38.714219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:38.714291 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:38.720606 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:08:38.724894 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:38.774495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.774678 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.775016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.775288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.775594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.775954 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:38.854391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.133s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:38.854818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.rescue {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:38.893608 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 for instance 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:08:38.918591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.rescue" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:38.919101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:38.919447 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'migration_context' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:39.097118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:08:39.097719 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:08:39.098138 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:39.098427 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:39.147181 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:08:39.147548 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772119.1473558, c6482b32-d458-4461-81de-fce59c1732fd => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:39.147650 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] VM Paused (Lifecycle Event)
May 26 05:08:39.187892 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e739c6600d84587806f8d18c8c064f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46d0ca59fdff45d28366bc7eaf9071dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:08:39.259507 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:39.284554 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Took 7.78 seconds to spawn the instance on the hypervisor.
May 26 05:08:39.284704 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:39.424409 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:39.424680 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:08:39.425451 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start _get_guest_xml network_info=[{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:14:7a:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:08:39.425655 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:39.603012 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:08:39.650122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:39.653818 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772119.652997, c6482b32-d458-4461-81de-fce59c1732fd => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:39.653818 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] VM Resumed (Lifecycle Event)
May 26 05:08:39.739460 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:39.741289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:39.741892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:39.742038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:39.742243 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:39.742401 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8ce9e8da-631a-4412-ba83-e64046e2d852 req-3ebd263d-60cd-499b-b916-d95595bbae2e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state active and task_state rescuing.
May 26 05:08:39.770176 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Successfully created port: 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:08:39.796784 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Took 13.45 seconds to build instance.
May 26 05:08:39.928093 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:39.931740 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:39.933870 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-408518215', uuid='b71f2db5-8f92-4400-bf45-634f9790fca0'), owner=OwnerMeta(userid='f0799194be46487e89960ac774578992', username='tempest-ServerRescueNegativeTestJSON-161865729-project-member', projectid='68b22c1abf2f4ba788005f454c7f8add', projectname='tempest-ServerRescueNegativeTestJSON-161865729'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:14:7a:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772119.9332838) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:08:39.935631 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:08:39.936074 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:08:39.937653 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:08:39.937653 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:08:39.938958 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:08:39.939164 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:08:39.939443 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:08:39.939596 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:08:39.939743 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:08:39.939857 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:08:39.940003 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:08:39.940223 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:08:39.941013 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:08:39.941013 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:08:39.941013 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:08:39.942413 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:08:39.942413 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'vcpu_model' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:40.107192 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:08:40.157777 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:40.163038 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:40.298486 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.964s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:40.356619 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Successfully updated port: 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:08:40.443590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:40.443779 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing instance network info cache due to event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:40.443942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:40.444509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:40.446040 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:40.452872 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:40.475119 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408518215',display_name='tempest-ServerRescueNegativeTestJSON-server-408518215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-408518215',id=43,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQA5euGQIXjkEDpFcEJt5fV8GhcPsOhTy6qROxtoGZT8rOzobviV08JWyiVPQbnrIuo7DyUwthH2j6fP9r4K+SNbTVM//Rx8D59+kVPF36sliDmpGym7Xb3zJg4hvy1fA==',key_name='tempest-keypair-1240985616',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:44Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-m99l0iin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0799194be46487e89960ac774578992',uuid=b71f2db5-8f92-4400-bf45-634f9790fca0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:14:7a:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:08:40.475806 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "vif_mac": "fa:16:3e:14:7a:24"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:40.477862 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:40.479970 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'pci_devices' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:40.613986 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Booting with volume 2c927b41-d2a6-4c61-bb16-42ff4b045c1c at /dev/vda
May 26 05:08:40.670391 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:40.675423 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772120.6723866, 7583fee2-acf9-4217-ad23-adca4ec3e186 => ua-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:08:40.678427 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully detached device vdb from instance 7583fee2-acf9-4217-ad23-adca4ec3e186 from the live domain config.
May 26 05:08:40.687010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:08:40.714512 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:08:40.715191 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:40.715693 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:40.716083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:40.732348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.015s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:40.734818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:08:40.735660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [116] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [97] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: tcp: [98] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23 (non-flash)
May 26 05:08:40.766413 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e6d0aabd-4654-4d53-8552-11392c6b6fe7', '116'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:08:40.766413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '97')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:40.768847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23', '98')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:08:40.772149 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac412a020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:08:40.772149 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:08:40.772149 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flush multipath device 33000000098d416b2 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:08:40.772596 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:08:40.772757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:08:40.792777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:08:40.794477 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe44:cce2', 'fe80::fc16:3eff:fe39:fdac', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:fee8:8965', 'fe80::dc23:30ff:fe28:fa8a'] 
May 26 05:08:40.794630 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:08:40.794804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:08:40.795134 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:40.795603 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating existing volume attachment record: 8c3372ae-3316-4737-99aa-162b1df88752 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:08:40.802251 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:08:40.848278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:08:40.864604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:40.900304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:08:40.900304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:08:40.900304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:08:40.911432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:08:40.912022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:08:40.925090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:40.962468 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:40.965611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 97, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.40.100,3260]
May 26 05:08:40.965611 np0000001388 nova-compute[98319]: Logout of [sid: 97, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.40.100,3260] successful.
May 26 05:08:40.965611 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:40.983240 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:40.985244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <uuid>b71f2db5-8f92-4400-bf45-634f9790fca0</uuid>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <name>instance-0000002b</name>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-408518215</nova:name>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:08:39</nova:creationTime>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:user uuid="f0799194be46487e89960ac774578992">tempest-ServerRescueNegativeTestJSON-161865729-project-member</nova:user>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:project uuid="68b22c1abf2f4ba788005f454c7f8add">tempest-ServerRescueNegativeTestJSON-161865729</nova:project>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         <nova:port uuid="fa4d215b-14db-4e8f-9be5-2be67ea1745d">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <system>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="serial">b71f2db5-8f92-4400-bf45-634f9790fca0</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="uuid">b71f2db5-8f92-4400-bf45-634f9790fca0</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </system>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <os>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </os>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <features>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </features>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   <devices>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.rescue"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config.rescue"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:14:7a:24"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <target dev="tapfa4d215b-14"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </interface>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/console.log" append="off"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </serial>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <video>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </video>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </rng>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:   </devices>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]: </domain>
May 26 05:08:40.985244 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:08:40.990030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:40.993661 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance destroyed successfully.
May 26 05:08:41.006322 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:41.045679 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:41.048487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 98, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.50.100,3260]
May 26 05:08:41.048487 np0000001388 nova-compute[98319]: Logout of [sid: 98, target: iqn.2023-03.storpool.com:os--volume-3ee838d8-aa3d-40c1-8e6a-3b27a87c4e23, portal: 192.168.50.100,3260] successful.
May 26 05:08:41.048487 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:41.073234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:41.073234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:41.073234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== disconnect_volume: return (354ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:41.073234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:08:41.229945 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:41.636777 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'flavor' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:41.732065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae00b17e-31b3-4b6a-873b-9f412e3c922c req-c723a2ab-ad39-4b51-98f6-8f622c1da4cf service nova] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:41.732541 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:41.732738 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:41.792532 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-changed-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:41.792725 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Refreshing instance network info cache due to event network-changed-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:41.792869 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] Acquiring lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:41.792970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] Acquired lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:41.794602 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Refreshing network info cache for port 8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:42.298906 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:42.300530 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:42.383993 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:42.521779 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:42.528413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:42.528736 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:42.528906 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:42.528991 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] No VIF found with MAC fa:16:3e:14:7a:24, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:42.529707 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Using config drive
May 26 05:08:42.643543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-41066306-50bc-4009-ae6d-eb65cfba52e0 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 7.055s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:42.723522 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:42.769306 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:42.912254 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updated VIF entry in instance network info cache for port 8226de6f-ae4b-43c9-9d6a-6d0388a2e3be. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:42.912806 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updating instance_info_cache with network_info: [{"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:42.917316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:08:42.918630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:08:42.918888 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating image(s)
May 26 05:08:42.919411 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:08:42.919498 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Ensure instance console log exists: /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:08:42.919745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:42.919937 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:42.920138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:43.032900 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'ec2_ids' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:43.225955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:43.226318 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance network_info: |[{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:08:43.227087 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start _get_guest_xml network_info=[{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '8c3372ae-3316-4737-99aa-162b1df88752', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c390c1f4-d1aa-446a-93c7-43417d742588', 'attached_at': '', 'detached_at': '', 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'serial': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:08:43.229562 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:43.230800 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1521278167', uuid='c390c1f4-d1aa-446a-93c7-43417d742588'), owner=OwnerMeta(userid='0e739c6600d84587806f8d18c8c064f1', username='tempest-TestShelveInstance-917468269-project-member', projectid='46d0ca59fdff45d28366bc7eaf9071dc', projectname='tempest-TestShelveInstance-917468269'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772123.2304294) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:08:43.231942 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:08:43.232339 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:08:43.233335 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:08:43.233515 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:08:43.234392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:08:43.234677 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:08:43.234826 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:08:43.234915 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:08:43.235017 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:08:43.235092 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:08:43.235182 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:08:43.235376 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:08:43.235475 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:08:43.235576 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:08:43.235670 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:08:43.235776 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:08:43.245176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:08:43.245563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:43.245733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:43.246151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:43.246382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:08:43.259231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:43.259840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:43.260569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:43.261463 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:43.261463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:43.261463 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:43.274095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:43.274095 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:43.279983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:43.279983 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:43.287825 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c] added
May 26 05:08:43.287825 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:43.287825 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:43.287825 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:43.287825 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:43.287825 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:43.287825 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:43.288235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:43.288281 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:43.288429 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:43.293910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c] added
May 26 05:08:43.293910 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:43.293910 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:43.293910 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:43.293910 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:43.293910 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:43.293910 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:43.294113 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:43.294262 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:43.294438 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:43.414910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff215876-566c-4bd3-84c3-ca61daac6995 req-f24cb17a-0cb1-44b2-abb6-b0d28bbc5e0a service nova] Releasing lock "refresh_cache-c6482b32-d458-4461-81de-fce59c1732fd" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:43.538083 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:43.538242 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'keypairs' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:44.043917 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:44.047344 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:44.207879 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Creating config drive at /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config.rescue
May 26 05:08:44.211454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnsu5vn7i {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:44.261222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:44.277417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnsu5vn7i" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:44.288986 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:44.295864 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:44.303447 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:44.303447 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:44.315240 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:44.315240 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.321242 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.326003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.337913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.337913 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.337913 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.337913 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.337913 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:44.338255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.338255 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.338255 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.338255 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.338255 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:44.343131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.343131 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.343131 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.343131 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.343131 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:44.343343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.343343 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.343343 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.343343 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.343343 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:44.375004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260]
May 26 05:08:44.375004 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260] successful.
May 26 05:08:44.375004 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.380686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260]
May 26 05:08:44.380686 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260] successful.
May 26 05:08:44.380686 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.388717 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.396406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.405190 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.405502 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:44.405884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:44.406057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:44.407035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] HCTL ('7', '-', '-', 0) found on session 117 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:44.407170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.415341 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:44.416141 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:44.416141 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:44.417151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] HCTL ('9', '-', '-', 0) found on session 118 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:44.417385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:44.426891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching for a device in session 117 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:44.427159 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:44.437936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching for a device in session 118 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:44.437936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:44.785646 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:44.815298 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:44.927549 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:45.024497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:45.025247 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:45.052235 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:45.052235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:45.052235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:45.052235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:45.052235 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:45.052513 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-76baf012-eb96-4e91-9cdd-adce31537dc9 req-8e8bf6c7-ee83-4361-8462-6fe64c53ee94 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state active and task_state rescuing.
May 26 05:08:45.264430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:08:45.686534 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for b71f2db5-8f92-4400-bf45-634f9790fca0 due to new event <LifecycleEvent: 1779772125.684017, b71f2db5-8f92-4400-bf45-634f9790fca0 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:08:45.686938 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772125.684017, b71f2db5-8f92-4400-bf45-634f9790fca0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:45.686938 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Resumed (Lifecycle Event)
May 26 05:08:45.691466 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9f8f4439-b40b-4171-869d-3d772e0eac09 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:45.790425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:45.790571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:46.190943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:46.192950 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:46.281437 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Found WWN 3300000004cda2c44 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:08:46.284391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:46.284391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000004cda2c44', 'path': '/dev/dm-1', 'multipath_id': '3300000004cda2c44'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:46.284391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004cda2c44', 'path': '/dev/dm-1', 'multipath_id': '3300000004cda2c44'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:08:46.298151 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:08:46.695796 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772126.6953154, b71f2db5-8f92-4400-bf45-634f9790fca0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:46.696278 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Started (Lifecycle Event)
May 26 05:08:46.788001 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrckk/r+WkT3AexHRfVCeISlqf2otyD3FzNcz6REARM00TA/PMkVHdRUj+2YqtchX2kG0Oag/lSUhJKOIIV+GNU5kVNqLRneKasaCRLw3CAHtT6Sfd4/IM8jSkU8L2cAQ==',key_name='tempest-TestShelveInstance-209725618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:40Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:08:46.788178 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:46.788887 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:46.789774 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'pci_devices' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:46.873533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:46.874038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:46.879387 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:08:46.879650 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Claim successful on node np0000001388
May 26 05:08:47.113596 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:47.113781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:47.113932 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:47.114354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:47.117501 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:47.117648 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e7f80926-1024-401d-908d-e47765af90c5 req-6a65c4e5-8f22-4c68-a16f-916558878b0e service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state rescued and task_state unrescuing.
May 26 05:08:47.198891 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:47.200517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:47.271986 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Unrescuing
May 26 05:08:47.272174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:47.272315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:47.272435 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:47.302596 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] End _get_guest_xml xml=<domain type="qemu">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <uuid>c390c1f4-d1aa-446a-93c7-43417d742588</uuid>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <name>instance-0000002e</name>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestShelveInstance-server-1521278167</nova:name>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:08:43</nova:creationTime>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:user uuid="0e739c6600d84587806f8d18c8c064f1">tempest-TestShelveInstance-917468269-project-member</nova:user>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:project uuid="46d0ca59fdff45d28366bc7eaf9071dc">tempest-TestShelveInstance-917468269</nova:project>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         <nova:port uuid="33ef0430-8f05-4754-8e51-b98e306d943f">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <system>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="serial">c390c1f4-d1aa-446a-93c7-43417d742588</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="uuid">c390c1f4-d1aa-446a-93c7-43417d742588</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </system>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <os>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </os>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <features>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </features>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   <devices>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <alias name="ua-2c927b41-d2a6-4c61-bb16-42ff4b045c1c"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <serial>2c927b41-d2a6-4c61-bb16-42ff4b045c1c</serial>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:49:b0:40"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <target dev="tap33ef0430-8f"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </interface>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/console.log" append="off"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </serial>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <video>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </video>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </rng>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:   </devices>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]: </domain>
May 26 05:08:47.302596 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Preparing to wait for external event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrckk/r+WkT3AexHRfVCeISlqf2otyD3FzNcz6REARM00TA/PMkVHdRUj+2YqtchX2kG0Oag/lSUhJKOIIV+GNU5kVNqLRneKasaCRLw3CAHtT6Sfd4/IM8jSkU8L2cAQ==',key_name='tempest-TestShelveInstance-209725618',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:40Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:08:47.305867 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:47.307586 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.310547 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c08b4196-8ab9-5d26-8327-dc87b4ff8141', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:47.311950 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.312394 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:47.316873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.320336 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.320599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33ef0430-8f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:47.321036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33ef0430-8f, col_values=(('qos', UUID('b4bbfaee-7a34-4fd4-8dad-5e34e0b95931')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:47.321266 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33ef0430-8f, col_values=(('external_ids', {'iface-id': '33ef0430-8f05-4754-8e51-b98e306d943f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:b0:40', 'vm-uuid': 'c390c1f4-d1aa-446a-93c7-43417d742588'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:47.325276 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.327331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:47.332416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.334420 np0000001388 nova-compute[98319]: INFO os_vif [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f')
May 26 05:08:47.388260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:47.703341 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] During sync_power_state the instance has a pending task (unrescuing). Skip.
May 26 05:08:47.774980 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:48.205925 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:48.410118 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:48.673273 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:08:48.673532 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:08:48.859313 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:48.859749 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:08:48.859749 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No VIF found with MAC fa:16:3e:49:b0:40, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:08:48.860251 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Using config drive
May 26 05:08:48.914231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:48.914231 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'flavor' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:49.176886 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:08:49.368670 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:49.453800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:49.480724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:49.564327 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating config drive at /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config
May 26 05:08:49.568359 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeb4j64cc {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:49.637985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpeb4j64cc" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:08:49.648759 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:49.649001 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:49.650392 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:49.650841 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:49.651911 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:49.651911 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-cd7dd2ee-9f93-400a-b670-014cc6e69291 req-ab0ff339-d1c7-4552-a6ad-28b9c4f23f1b service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state rescued and task_state unrescuing.
May 26 05:08:49.658985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:49.670076 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:49.684023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.810s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:49.684376 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:08:50.191397 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:08:50.191873 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:08:50.192078 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:50.192393 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:50.214407 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999575969000034 future=<Future at 0x7d7aa446c410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:50.218500 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance destroyed successfully.
May 26 05:08:50.219057 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'numa_topology' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:50.220452 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.251441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.253260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.317165 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60d48ed701e84f978f7e0559581a07c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '056a9cea608647fda5cc210009e4e5fc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:08:50.358299 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.438943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53b9ab98-9f0b-4287-a592-edb82f2861da req-9a11d538-55e5-4058-b785-f8e946efd427 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:50.440171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53b9ab98-9f0b-4287-a592-edb82f2861da req-9a11d538-55e5-4058-b785-f8e946efd427 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:50.440425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53b9ab98-9f0b-4287-a592-edb82f2861da req-9a11d538-55e5-4058-b785-f8e946efd427 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:50.440936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53b9ab98-9f0b-4287-a592-edb82f2861da req-9a11d538-55e5-4058-b785-f8e946efd427 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:50.440936 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53b9ab98-9f0b-4287-a592-edb82f2861da req-9a11d538-55e5-4058-b785-f8e946efd427 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Processing event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:08:50.590305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.619601 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.627372 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.635462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.663566 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.672540 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:50.696386 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:08:50.723033 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Object Instance<b71f2db5-8f92-4400-bf45-634f9790fca0> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:08:50.869014 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Successfully created port: d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:08:51.200110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:08:51.209443 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:08:51.213547 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772131.2092342, c390c1f4-d1aa-446a-93c7-43417d742588 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:51.213814 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Started (Lifecycle Event)
May 26 05:08:51.217489 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:08:51.228532 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance spawned successfully.
May 26 05:08:51.229125 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:08:51.257337 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:51.288058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:51.383578 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:51.471736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:51.472533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:51.574162 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Successfully updated port: d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:08:51.704132 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Booting with volume 9addde38-348d-46b3-8a36-458df21fe824 at /dev/vda
May 26 05:08:51.719590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:51.732297 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:51.732297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:51.732297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:51.732297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:51.732468 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:51.732877 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state rescued and task_state unrescuing.
May 26 05:08:51.734494 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:51.735693 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:51.735957 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:51.736164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:51.736409 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:51.736829 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state rescued and task_state unrescuing.
May 26 05:08:51.737448 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-changed-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:51.737448 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Refreshing instance network info cache due to event network-changed-d9b5bed6-6ab5-4792-a118-975dbb7fc927. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:51.737708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Acquiring lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:51.737842 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Acquired lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:51.738071 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Refreshing network info cache for port d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:51.745951 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:51.749186 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.749377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.749766 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.750061 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.750365 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.750604 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:08:51.759945 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:51.774214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:08:51.803115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:08:51.855082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:08:51.855571 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:08:51.865293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:08:51.868174 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe44:cce2', 'fe80::fc16:3eff:fe39:fdac', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:fee8:8965', 'fe80::dc23:30ff:fe28:fa8a', 'fe80::fc16:3eff:fe49:b040', 'fe80::64af:abff:fedd:b0ee', 'fe80::fc16:3eff:fe14:7a24'] 
May 26 05:08:51.868370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:08:51.868640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:08:51.868779 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:51.869008 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Updating existing volume attachment record: 5bfed3a8-0ced-4c87-86b1-2aa4f418e85f {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:08:52.076682 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:52.212503 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3140e9fa-956b-42ce-b9e6-970301c0bd19 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:52.243246 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:52.257399 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Took 9.34 seconds to spawn the instance on the hypervisor.
May 26 05:08:52.258986 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:08:52.261181 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:52.261373 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772132.2590926, c390c1f4-d1aa-446a-93c7-43417d742588 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:52.261550 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Paused (Lifecycle Event)
May 26 05:08:52.323860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:52.353870 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:52.387788 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:52.533953 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:52.534290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:52.534531 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:52.534678 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:52.534763 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:52.534964 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-82486d40-162a-4745-a9e6-98d73503b729 req-d2332e4e-3ace-43ed-9dc1-91f010c50c61 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received unexpected event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with vm_state active and task_state None.
May 26 05:08:52.569041 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:52.686179 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00041089500018642866 future=<Future at 0x7d7aa437ee10 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:52.686179 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:52.686179 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.527875019000021 future=<Future at 0x7d7aa446c410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:52.686179 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.52776986300023 future=<Future at 0x7d7aa446c410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:08:52.770422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:52.777530 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Took 18.15 seconds to build instance.
May 26 05:08:52.779801 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772132.779519, c390c1f4-d1aa-446a-93c7-43417d742588 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:52.780034 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Resumed (Lifecycle Event)
May 26 05:08:53.072076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2a339f4-8ef8-45c4-810d-56bc9590571c req-95b36004-8967-44fc-9bab-9d9110b8b006 service nova] Releasing lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:53.072458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquired lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:53.072636 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:08:53.283517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43e36a92-b753-4cab-abf1-45cf0e5692e2 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.658s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:53.284450 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:53.286155 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:53.660920 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:08:53.788524 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for b71f2db5-8f92-4400-bf45-634f9790fca0 due to new event <LifecycleEvent: 1779772133.7881756, b71f2db5-8f92-4400-bf45-634f9790fca0 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:08:53.788689 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772133.7881756, b71f2db5-8f92-4400-bf45-634f9790fca0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:53.788852 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Resumed (Lifecycle Event)
May 26 05:08:53.810886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:53.810951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:53.811123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:53.811322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:53.811841 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:08:53.811955 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-aaa3e886-7f0e-4563-89bc-022655affafb req-4f5bf4c1-4572-4022-bd2e-1e6f09098289 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received unexpected event network-vif-plugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with vm_state active and task_state None.
May 26 05:08:53.877036 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:53.999186 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:08:54.000405 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:08:54.000729 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Creating image(s)
May 26 05:08:54.001040 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:08:54.001165 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Ensure instance console log exists: /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:08:54.001461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:54.001620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:54.001759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:54.040801 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Updating instance_info_cache with network_info: [{"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:54.186359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:54.186569 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing instance network info cache due to event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:54.186659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:54.186741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:54.186857 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:54.292844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:54.296254 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:54.542950 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Releasing lock "refresh_cache-24459176-363e-4fe8-afa2-7838962f71d1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:54.543429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance network_info: |[{"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:08:54.544343 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Start _get_guest_xml network_info=[{"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '5bfed3a8-0ced-4c87-86b1-2aa4f418e85f', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '24459176-363e-4fe8-afa2-7838962f71d1', 'attached_at': '', 'detached_at': '', 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'serial': '9addde38-348d-46b3-8a36-458df21fe824', 'multiattach': True}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:08:54.549895 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:08:54.551496 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-729964751', uuid='24459176-363e-4fe8-afa2-7838962f71d1'), owner=OwnerMeta(userid='60d48ed701e84f978f7e0559581a07c1', username='tempest-AttachVolumeMultiAttachTest-2062276086-project-member', projectid='056a9cea608647fda5cc210009e4e5fc', projectname='tempest-AttachVolumeMultiAttachTest-2062276086'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772134.5509865) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:08:54.552816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:08:54.553330 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:08:54.554417 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:08:54.554648 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:08:54.555876 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:08:54.556303 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:08:54.556513 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:08:54.556657 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:08:54.556809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:08:54.556917 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:08:54.557066 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:08:54.557362 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:08:54.557524 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:08:54.557702 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:08:54.557864 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:08:54.558051 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:08:54.574710 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:08:54.575357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:08:54.575532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:54.576151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:54.576414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:08:54.590328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:54.590942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:08:54.591391 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:54.591597 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:54.591923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:08:54.592103 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:54.604584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:54.604584 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:54.613946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:08:54.613946 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:54.618932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824] added
May 26 05:08:54.618932 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:54.618932 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:54.618932 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:54.618932 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:54.618932 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:54.618932 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:54.619785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:54.619785 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0272(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:54.619785 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:54.625949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824] added
May 26 05:08:54.625949 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:08:54.625949 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:54.625949 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:54.625949 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:08:54.625949 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:08:54.625949 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:54.626563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:08:54.626563 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:08:54.626563 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:08:54.688934 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:54.801291 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772134.799393, b71f2db5-8f92-4400-bf45-634f9790fca0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:08:54.801291 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Started (Lifecycle Event)
May 26 05:08:55.141959 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:55.305934 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:08:55.307465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:08:55.360625 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updated VIF entry in instance network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:55.365003 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:55.620381 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:08:55.626885 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:55.637917 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:55.637917 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:08:55.646581 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:08:55.646581 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.654996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.663799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.673700 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.681407 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.681934 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:55.725124 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.50.100,3260]
May 26 05:08:55.725124 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.50.100,3260] successful.
May 26 05:08:55.725124 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.736698 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.40.100,3260]
May 26 05:08:55.736698 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.40.100,3260] successful.
May 26 05:08:55.736698 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.745767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.751129 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.763782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.766625 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('10', '-', '-', 0) found on session 119 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:55.766625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.772879 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:08:55.773162 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:08:55.773460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:55.773603 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:08:55.774458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] HCTL ('12', '-', '-', 0) found on session 120 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:08:55.774592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:08:55.789358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 119 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:55.789358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:55.799349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 120 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:55.868630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-798a9441-c4a4-4a20-aaef-c29b09a0a238 req-829d99be-477b-4bd4-97c0-e6739a1f49ea service nova] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:55.914974 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:55.914974 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing instance network info cache due to event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:55.914974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:55.914974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:55.914974 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:56.263444 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:08:56.264219 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing instance network info cache due to event network-changed-fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:08:56.264425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] Acquiring lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:08:56.264582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] Acquired lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:08:56.264751 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Refreshing network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:08:56.417948 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:56.772133 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:56.798319 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Searching for a device in session 120 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:08:56.798470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:08:57.079902 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:57.231550 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updated VIF entry in instance network info cache for port fa4d215b-14db-4e8f-9be5-2be67ea1745d. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:57.231842 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [{"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:57.303628 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:08:57.325851 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:57.389761 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:57.489183 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updated VIF entry in instance network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:08:57.489183 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:08:57.610155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Found WWN 33000000005f7fb86 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:08:57.610529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:08:57.610829 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '33000000005f7fb86', 'path': '/dev/dm-4', 'multipath_id': '33000000005f7fb86'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:08:57.610965 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000005f7fb86', 'path': '/dev/dm-4', 'multipath_id': '33000000005f7fb86'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:08:57.734507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b2b14409-c2c4-4adb-91e3-acbb69183cac req-9f713b9b-d86b-44a6-a323-4ff7b8a33ec9 service nova] Releasing lock "refresh_cache-b71f2db5-8f92-4400-bf45-634f9790fca0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:57.991711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36696590-50d1-4ea2-919f-26cf16dfdc43 req-c537ab95-b24c-4aba-b72b-7de798e74fdd service nova] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:08:58.116522 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-729964751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-729964751',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-tfhoeo9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:51Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=24459176-363e-4fe8-afa2-7838962f71d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:08:58.116712 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:58.117339 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:58.118045 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'pci_devices' on Instance uuid 24459176-363e-4fe8-afa2-7838962f71d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:08:58.621270 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] End _get_guest_xml xml=<domain type="qemu">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <uuid>24459176-363e-4fe8-afa2-7838962f71d1</uuid>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <name>instance-0000002f</name>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeMultiAttachTest-server-729964751</nova:name>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:08:54</nova:creationTime>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:user uuid="60d48ed701e84f978f7e0559581a07c1">tempest-AttachVolumeMultiAttachTest-2062276086-project-member</nova:user>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:project uuid="056a9cea608647fda5cc210009e4e5fc">tempest-AttachVolumeMultiAttachTest-2062276086</nova:project>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         <nova:port uuid="d9b5bed6-6ab5-4792-a118-975dbb7fc927">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <system>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="serial">24459176-363e-4fe8-afa2-7838962f71d1</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="uuid">24459176-363e-4fe8-afa2-7838962f71d1</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </system>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <os>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </os>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <features>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </features>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   <devices>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/disk.config"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <alias name="ua-9addde38-348d-46b3-8a36-458df21fe824"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <serial>9addde38-348d-46b3-8a36-458df21fe824</serial>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <shareable/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </disk>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b3:2c:4e"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <target dev="tapd9b5bed6-6a"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </interface>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/console.log" append="off"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </serial>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <video>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </video>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </rng>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:   </devices>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]: </domain>
May 26 05:08:58.621270 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Preparing to wait for external event network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-729964751',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-729964751',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-tfhoeo9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:08:51Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=24459176-363e-4fe8-afa2-7838962f71d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.630000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c77bcd7-c79f-5654-93aa-0508a714f586', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:58.634897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.634897 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:58.636416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.636701 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9b5bed6-6a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:58.637214 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9b5bed6-6a, col_values=(('qos', UUID('e70515c6-6c99-4042-958b-b2c88ee9b3cc')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:58.637480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9b5bed6-6a, col_values=(('external_ids', {'iface-id': 'd9b5bed6-6ab5-4792-a118-975dbb7fc927', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:2c:4e', 'vm-uuid': '24459176-363e-4fe8-afa2-7838962f71d1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:08:58.638638 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.640301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:08:58.646792 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:08:58.647934 np0000001388 nova-compute[98319]: INFO os_vif [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a')
May 26 05:09:00.167194 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:00.167194 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:00.167873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] No VIF found with MAC fa:16:3e:b3:2c:4e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:09:00.167873 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Using config drive
May 26 05:09:00.674228 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:00.813835 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Creating config drive at /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/disk.config
May 26 05:09:00.816865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgvycc3cx {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:00.886329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgvycc3cx" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:01.324474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:01.365619 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:01.454473 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:01.549904 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3944a4a2-aa16-41e1-83b8-07c3d9057e07 req-cb9ec110-ac48-46a7-898e-2161511ea6d6 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:01.550390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3944a4a2-aa16-41e1-83b8-07c3d9057e07 req-cb9ec110-ac48-46a7-898e-2161511ea6d6 service nova] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:01.550667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3944a4a2-aa16-41e1-83b8-07c3d9057e07 req-cb9ec110-ac48-46a7-898e-2161511ea6d6 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:01.550710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3944a4a2-aa16-41e1-83b8-07c3d9057e07 req-cb9ec110-ac48-46a7-898e-2161511ea6d6 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:01.550820 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3944a4a2-aa16-41e1-83b8-07c3d9057e07 req-cb9ec110-ac48-46a7-898e-2161511ea6d6 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Processing event network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:09:01.551786 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:01.552905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:02.120857 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772142.120447, 24459176-363e-4fe8-afa2-7838962f71d1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:02.121344 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] VM Started (Lifecycle Event)
May 26 05:09:02.123045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:09:02.128266 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:09:02.133113 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance spawned successfully.
May 26 05:09:02.133113 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:09:02.390859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:02.625723 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:02.629452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:09:02.639628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:02.639628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:02.639628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:02.639628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:02.639893 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:02.639975 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:03.133812 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:09:03.133812 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772143.1306934, 24459176-363e-4fe8-afa2-7838962f71d1 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:03.133812 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] VM Paused (Lifecycle Event)
May 26 05:09:03.145265 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Took 9.15 seconds to spawn the instance on the hypervisor.
May 26 05:09:03.145673 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:03.629857 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:03.630219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:03.630219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:03.630941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:03.630941 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] No waiting events found dispatching network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:03.630941 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d2484024-e08e-4d87-af53-56ac5c87e3be req-32052287-e73c-4219-a6a6-600ae8995283 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received unexpected event network-vif-plugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 for instance with vm_state active and task_state None.
May 26 05:09:03.636391 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:03.639834 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:03.640399 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772143.6401024, 24459176-363e-4fe8-afa2-7838962f71d1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:03.640494 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] VM Resumed (Lifecycle Event)
May 26 05:09:03.662318 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Took 16.86 seconds to build instance.
May 26 05:09:04.144499 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:04.146779 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:09:04.166640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.376s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:05.215639 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0016422819999206695 future=<Future at 0x7d7aa446c410 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:05.216483 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:07.402435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:07.496630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:07.496830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:07.497176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:07.497176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:07.497461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:07.499607 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Terminating instance
May 26 05:09:08.004580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:08.053160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.058543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.085342 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.305376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.306226 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:08.306517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:08.306757 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:08.306956 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:08.310529 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] No waiting events found dispatching network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:08.310726 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a412f98e-1265-4815-a063-e7e09d27fcce req-1b1ac3ec-fcd4-48ad-ad0c-4377139a486e service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:08.316023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.365056 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.375983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.388971 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999631722000231 future=<Future at 0x7d7aa446f380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:08.391121 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997487126000124 future=<Future at 0x7d7aa446f380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:08.391444 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997110982000322 future=<Future at 0x7d7aa446f380 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:08.396851 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Instance destroyed successfully.
May 26 05:09:08.398362 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid 24459176-363e-4fe8-afa2-7838962f71d1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:08.643604 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.902446 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-729964751',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-729964751',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:09:03Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-tfhoeo9m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:09:03Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=24459176-363e-4fe8-afa2-7838962f71d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:08.902763 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "address": "fa:16:3e:b3:2c:4e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9b5bed6-6a", "ovs_interfaceid": "d9b5bed6-6ab5-4792-a118-975dbb7fc927", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:08.903649 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:08.904346 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:08.909561 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.909859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9b5bed6-6a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:08.912019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.914604 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:08.916987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:08.917172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e70515c6-6c99-4042-958b-b2c88ee9b3cc) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:08.919246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:08.923342 np0000001388 nova-compute[98319]: INFO os_vif [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:2c:4e,bridge_name='br-int',has_traffic_filtering=True,id=d9b5bed6-6ab5-4792-a118-975dbb7fc927,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9b5bed6-6a')
May 26 05:09:08.970593 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:08.970759 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:08.971065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:08.971226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:08.971570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '9addde38-348d-46b3-8a36-458df21fe824', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:08.971699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:09.000905 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [119] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [120] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824 (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:09.001341 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:09.001341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '118'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', '119'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', '120'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:09.003393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', '120')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:09.003393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824', '119')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:09.003661 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f1f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:09.003899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Removing multipathed devices sde, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:09:09.004210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flush multipath device 33000000005f7fb86 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:09:09.059174 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:09.114273 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:09.162247 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if SCSI volumes sde, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:09:09.162556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] SCSI volumes sde, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:09:09.164436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if device paths {'sde', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:09:09.176890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Device paths {'sde', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:09:09.177113 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:09.193919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.229626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 120, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.40.100,3260]
May 26 05:09:09.229626 np0000001388 nova-compute[98319]: Logout of [sid: 120, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.40.100,3260] successful.
May 26 05:09:09.229626 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.245343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.256848 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.286018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 119, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.50.100,3260]
May 26 05:09:09.286018 np0000001388 nova-compute[98319]: Logout of [sid: 119, target: iqn.2023-03.storpool.com:os--volume-9addde38-348d-46b3-8a36-458df21fe824, portal: 192.168.50.100,3260] successful.
May 26 05:09:09.286018 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.308223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:09.308526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:09.308701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== disconnect_volume: return (338ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:09.308911 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:09.309366 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Deleting instance files /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1_del
May 26 05:09:09.309966 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Deletion of /opt/stack/data/nova/instances/24459176-363e-4fe8-afa2-7838962f71d1_del complete
May 26 05:09:09.820940 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Took 1.82 seconds to destroy the instance on the hypervisor.
May 26 05:09:09.821827 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:09.822039 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:09.822240 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:09.822461 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:09.897604 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:10.255225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e5d1577b-4405-43ad-b8ff-eb11b25b9140 req-14f3cb7c-e61e-4c71-8067-d1aab3c96618 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-deleted-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:10.255683 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-e5d1577b-4405-43ad-b8ff-eb11b25b9140 req-14f3cb7c-e61e-4c71-8067-d1aab3c96618 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Neutron deleted interface d9b5bed6-6ab5-4792-a118-975dbb7fc927; detaching it from the instance and deleting it from the info cache
May 26 05:09:10.255906 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e5d1577b-4405-43ad-b8ff-eb11b25b9140 req-14f3cb7c-e61e-4c71-8067-d1aab3c96618 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:10.386273 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:10.386273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] Acquiring lock "24459176-363e-4fe8-afa2-7838962f71d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:10.386273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:10.386994 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] Lock "24459176-363e-4fe8-afa2-7838962f71d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:10.387927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] No waiting events found dispatching network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:10.387927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-740d4cd3-cdcd-4da0-9b38-dd4105d0a88f req-c329c662-0dd1-4379-bb69-f1d9f6b3f113 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Received event network-vif-unplugged-d9b5bed6-6ab5-4792-a118-975dbb7fc927 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:10.690436 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:10.760013 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e5d1577b-4405-43ad-b8ff-eb11b25b9140 req-14f3cb7c-e61e-4c71-8067-d1aab3c96618 service nova] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Detach interface failed, port_id=d9b5bed6-6ab5-4792-a118-975dbb7fc927, reason: Instance 24459176-363e-4fe8-afa2-7838962f71d1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:09:11.192567 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Took 1.37 seconds to deallocate network for instance.
May 26 05:09:11.749776 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Took 0.56 seconds to detach 1 volumes for instance.
May 26 05:09:12.255834 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:12.256175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:12.406118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:12.939390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:12.939597 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:13.443249 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:13.917949 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:13.950711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.695s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:14.006696 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance 24459176-363e-4fe8-afa2-7838962f71d1
May 26 05:09:15.014488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e28db0a2-6f3c-4f31-a319-a7a1960ce8ca tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "24459176-363e-4fe8-afa2-7838962f71d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.517s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:15.080969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:15.080969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:15.584867 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:16.589237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:17.390692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:17.390872 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:17.407590 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:17.658700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:17.659160 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:17.659160 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Attaching volume f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f to /dev/vdb
May 26 05:09:17.696891 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:17.706366 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:09:17.729513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:17.772736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:09:17.772926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:09:17.780737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:09:17.783210 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe44:cce2', 'fe80::fc16:3eff:fe39:fdac', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:fee8:8965', 'fe80::dc23:30ff:fe28:fa8a', 'fe80::fc16:3eff:fe49:b040', 'fe80::64af:abff:fedd:b0ee', 'fe80::fc16:3eff:fe14:7a24'] 
May 26 05:09:17.783355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:09:17.783506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:09:17.783719 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:17.783925 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating existing volume attachment record: b5ce785a-32da-4745-b3f3-b8f87ded7e7c {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:09:17.894372 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:18.339905 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:09:18.340228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:18.340425 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:18.341003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:18.341337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:09:18.352599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:18.353038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:18.353225 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:18.353908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:18.354625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:18.354876 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:18.365585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:18.365585 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:18.368429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:18.368429 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:18.376683 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f] added
May 26 05:09:18.376683 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:18.376683 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:18.376683 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:18.376683 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:18.376683 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:18.376683 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:18.376942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:18.377114 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0238(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:18.377305 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:18.381864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f] added
May 26 05:09:18.381864 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:18.381864 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:18.381864 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:18.381864 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:18.381864 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:18.381864 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:18.382228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:18.382228 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0273(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:18.382397 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:18.398066 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Ignoring supplied device name: /dev/vdb
May 26 05:09:18.411343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:18.411557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:18.411694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:18.411805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:18.411961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:18.413923 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Terminating instance
May 26 05:09:18.900368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:18.917345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:18.919291 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:18.936417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:18.972586 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.110423 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.113884 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:19.113884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:19.114094 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:19.114638 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:19.114806 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:19.114993 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94ba4a1b-28c6-4672-b982-b76ed0b80bfa req-c481ff14-0f45-4124-bca0-96f538f9c7ec service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:19.118091 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.243787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.252985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.273684 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999667038000098 future=<Future at 0x7d7aa445aa50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:19.275040 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Instance destroyed successfully.
May 26 05:09:19.275596 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid 7583fee2-acf9-4217-ad23-adca4ec3e186 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:19.378011 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:19.384010 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:19.393629 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:19.393629 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:19.399584 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:19.399584 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.408736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.418699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.428869 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.435907 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.436362 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:19.472744 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.40.100,3260]
May 26 05:09:19.472744 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.40.100,3260] successful.
May 26 05:09:19.472744 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.481830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.50.100,3260]
May 26 05:09:19.481830 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.50.100,3260] successful.
May 26 05:09:19.481830 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.489278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.498500 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.510864 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:19.510864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:19.513234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('10', '-', '-', 0) found on session 125 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:19.513234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.521613 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:19.522238 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:19.522238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:19.523041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('12', '-', '-', 0) found on session 126 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:19.523116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:19.531214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 125 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:19.531214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:19.540898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 126 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:19.778002 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=39,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:02Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-s8txgqiy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:08:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=7583fee2-acf9-4217-ad23-adca4ec3e186,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:19.778897 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "a8308c82-1af4-4f92-9424-20cd5c165b63", "address": "fa:16:3e:44:cc:e2", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8308c82-1a", "ovs_interfaceid": "a8308c82-1af4-4f92-9424-20cd5c165b63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:19.778897 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:19.779124 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:19.782541 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.782822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8308c82-1a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:19.785407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.785407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:19.787736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.787916 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6da2ba7b-53a9-4868-b5e9-95902451b2d4) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:19.788443 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.788909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:19.790424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:19.794672 np0000001388 nova-compute[98319]: INFO os_vif [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:cc:e2,bridge_name='br-int',has_traffic_filtering=True,id=a8308c82-1af4-4f92-9424-20cd5c165b63,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8308c82-1a')
May 26 05:09:19.795018 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Deleting instance files /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_del
May 26 05:09:19.804499 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Deletion of /opt/stack/data/nova/instances/7583fee2-acf9-4217-ad23-adca4ec3e186_del complete
May 26 05:09:20.092085 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:20.092575 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:20.092575 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Attaching volume 0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c to /dev/vdb
May 26 05:09:20.137789 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:20.148643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:09:20.172394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:20.221919 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:09:20.222257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:09:20.231071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:09:20.233351 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::fc16:3eff:fe22:1b83', 'fe80::fc16:3eff:feea:3c2e', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fe34:860d', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe39:fdac', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:fee8:8965', 'fe80::dc23:30ff:fe28:fa8a', 'fe80::fc16:3eff:fe49:b040', 'fe80::64af:abff:fedd:b0ee', 'fe80::fc16:3eff:fe14:7a24'] 
May 26 05:09:20.233517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:09:20.233710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:09:20.234065 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:20.234415 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updating existing volume attachment record: 2b0cd432-bce5-45f8-beca-ada752b6515b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:09:20.315479 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:09:20.316866 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:20.317416 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:20.317416 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:20.317804 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:20.468233 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:20.541789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 126 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:20.542317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:20.794355 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:09:20.794692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:20.794937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:21.004267 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c32581f4-59e9-4cf7-8bfb-e4d30fca6c81 req-f7575e7d-e681-4fcd-919b-b4de31ead46c service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-deleted-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:21.004755 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-c32581f4-59e9-4cf7-8bfb-e4d30fca6c81 req-f7575e7d-e681-4fcd-919b-b4de31ead46c service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Neutron deleted interface a8308c82-1af4-4f92-9424-20cd5c165b63; detaching it from the instance and deleting it from the info cache
May 26 05:09:21.004911 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c32581f4-59e9-4cf7-8bfb-e4d30fca6c81 req-f7575e7d-e681-4fcd-919b-b4de31ead46c service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:21.180323 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:21.182109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] Acquiring lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:21.182109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:21.182109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:21.182109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] No waiting events found dispatching network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:21.182109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-75419853-0eda-49d0-a42e-792cfb436a1d req-2279e260-0dd0-4a82-85d0-258fe32cb2b0 service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Received event network-vif-unplugged-a8308c82-1af4-4f92-9424-20cd5c165b63 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:21.373239 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found WWN 330000000aa039139 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:09:21.373624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:21.374439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000aa039139', 'path': '/dev/dm-4', 'multipath_id': '330000000aa039139'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:21.374564 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000aa039139', 'path': '/dev/dm-4', 'multipath_id': '330000000aa039139'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:09:21.375023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.579s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:21.375227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:09:21.379221 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:21.387173 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:21.387772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:21.388663 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:21.389349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:21.391974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:21.392154 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:21.401626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:21.401626 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:21.406445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:21.406445 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:21.413529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c] added
May 26 05:09:21.413529 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:21.413529 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:21.413529 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:21.413529 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:21.413529 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:21.413529 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:21.413775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:21.413910 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:21.414079 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:21.418707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c] added
May 26 05:09:21.418707 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:21.418707 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:21.418707 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:21.418707 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:21.418707 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:21.418707 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:21.418879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:21.419015 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0269(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:21.419165 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:21.454264 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:21.509681 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c32581f4-59e9-4cf7-8bfb-e4d30fca6c81 req-f7575e7d-e681-4fcd-919b-b4de31ead46c service nova] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Detach interface failed, port_id=a8308c82-1af4-4f92-9424-20cd5c165b63, reason: Instance 7583fee2-acf9-4217-ad23-adca4ec3e186 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:09:21.883630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Attempting to attach volume f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:09:21.885526 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:   <alias name="ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f"/>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:   <serial>f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f</serial>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:21.885526 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:09:21.957020 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Took 1.64 seconds to deallocate network for instance.
May 26 05:09:22.410287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:22.414783 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:22.419539 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:22.430465 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:22.430465 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:22.439333 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:22.439333 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.445265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.452902 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.462484 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.462881 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:22.467212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:22.467398 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.473664 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.474034 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:22.510437 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.40.100,3260]
May 26 05:09:22.510437 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.40.100,3260] successful.
May 26 05:09:22.510437 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.527348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.536914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.50.100,3260]
May 26 05:09:22.536914 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.50.100,3260] successful.
May 26 05:09:22.536914 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.549942 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.550443 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:22.550735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:22.550735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:22.551852 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] HCTL ('13', '-', '-', 0) found on session 127 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:22.552010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:22.557643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:22.571553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching for a device in session 127 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:22.571553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.581555 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:22.581923 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:22.582115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:22.582397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:22.583739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] HCTL ('16', '-', '-', 0) found on session 128 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:22.583884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:22.600314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Searching for a device in session 128 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:22.600314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:23.071183 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:23.071420 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:23.389038 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004301439998926071 future=<Future at 0x7d7aa446f380 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:23.390148 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772148.3884819, 24459176-363e-4fe8-afa2-7838962f71d1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:23.390405 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:23.390626 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] VM Stopped (Lifecycle Event)
May 26 05:09:23.391723 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.881595607000236 future=<Future at 0x7d7aa445aa50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:23.391833 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.881461816999945 future=<Future at 0x7d7aa445aa50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:23.393632 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:09:23.565324 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:23.565324 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:23.565907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:23.565907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:39:fd:ac, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:09:23.576229 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:23.896687 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 24459176-363e-4fe8-afa2-7838962f71d1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:24.083240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.613s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:24.142525 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance 7583fee2-acf9-4217-ad23-adca4ec3e186
May 26 05:09:24.409526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found WWN 330000000b4866d25 for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:09:24.409728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:24.409877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== connect_volume: return (3615ms) {'type': 'block', 'scsi_wwn': '330000000b4866d25', 'path': '/dev/dm-5', 'multipath_id': '330000000b4866d25'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:24.409962 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000b4866d25', 'path': '/dev/dm-5', 'multipath_id': '330000000b4866d25'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:09:24.412208 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:24.789509 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:24.915169 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Attempting to attach volume 0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:09:24.917313 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:   <alias name="ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c"/>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:   <serial>0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c</serial>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:24.917313 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:09:25.127622 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-804fe7c6-8095-47f5-8f92-4e46580595b4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.469s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:25.153079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-eccf9263-7d39-4123-af5b-2fa2a67c5245 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "7583fee2-acf9-4217-ad23-adca4ec3e186" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.741s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:25.730252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:25.730252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:25.730252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:25.730494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:25.730562 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:25.733620 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Terminating instance
May 26 05:09:26.236218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:26.253459 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:26.256946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:26.276712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:26.389832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:26.389966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:26.390132 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:26.390280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:26.390429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:26.390544 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b975806-234d-4169-81fd-275695dcf536 req-af3f3a2c-6539-426f-8652-d9c5847f1a00 service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:26.413180 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:26.419187 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:26.504796 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:26.506229 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:26.565056 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999710079000124 future=<Future at 0x7d7ac411d250 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:26.566580 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Instance destroyed successfully.
May 26 05:09:26.567005 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid 67e6c789-cd47-4a9d-85a4-3c51faa4d646 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:26.599289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:26.599289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:26.599516 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:26.599554 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No VIF found with MAC fa:16:3e:e8:89:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:09:26.617781 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:26.618047 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:27.069325 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:05:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(12),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=36,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-jf9pv50g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:07:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=67e6c789-cd47-4a9d-85a4-3c51faa4d646,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:27.069585 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "f0f7ac1e-f1fb-4712-80af-906a91796719", "address": "fa:16:3e:34:86:0d", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0f7ac1e-f1", "ovs_interfaceid": "f0f7ac1e-f1fb-4712-80af-906a91796719", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:27.070050 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:27.070282 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:27.071804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.072067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0f7ac1e-f1, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:27.073117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.074012 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68a53d4b-02df-4030-b527-42092d15f31e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.078093 np0000001388 nova-compute[98319]: INFO os_vif [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:86:0d,bridge_name='br-int',has_traffic_filtering=True,id=f0f7ac1e-f1fb-4712-80af-906a91796719,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0f7ac1e-f1')
May 26 05:09:27.078396 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Deleting instance files /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_del
May 26 05:09:27.085493 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Deletion of /opt/stack/data/nova/instances/67e6c789-cd47-4a9d-85a4-3c51faa4d646_del complete
May 26 05:09:27.348802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:27.349098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:27.411820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:27.590747 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:09:27.591380 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:27.591517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:27.591598 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:27.591854 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:27.617590 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:27.617851 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:27.618504 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:27.664427 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:27.850631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:09:27.956776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-db49362e-2eaf-4a94-bcec-609914007d42 req-163a8c18-7206-4d52-9c67-897a80c931af service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-deleted-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:27.956944 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-db49362e-2eaf-4a94-bcec-609914007d42 req-163a8c18-7206-4d52-9c67-897a80c931af service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Neutron deleted interface f0f7ac1e-f1fb-4712-80af-906a91796719; detaching it from the instance and deleting it from the info cache
May 26 05:09:27.957004 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-db49362e-2eaf-4a94-bcec-609914007d42 req-163a8c18-7206-4d52-9c67-897a80c931af service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:28.153273 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba3c3d76-b058-44b2-9078-b5e15dbded06 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.060s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:28.408024 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:28.412438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:28.412689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:28.415950 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:09:28.416113 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Claim successful on node np0000001388
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] Acquiring lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] No waiting events found dispatching network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:28.460060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6ff4d23-063f-46b2-a846-061857673638 req-704f9a62-2e56-4129-a5d6-2e07ea1e784b service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Received event network-vif-unplugged-f0f7ac1e-f1fb-4712-80af-906a91796719 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:28.461600 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-db49362e-2eaf-4a94-bcec-609914007d42 req-163a8c18-7206-4d52-9c67-897a80c931af service nova] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Detach interface failed, port_id=f0f7ac1e-f1fb-4712-80af-906a91796719, reason: Instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:09:28.618174 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:28.618483 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:28.910928 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Took 1.32 seconds to deallocate network for instance.
May 26 05:09:29.417274 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:29.617517 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:29.617803 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:29.937295 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:29.937506 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:30.440092 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:30.617705 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:30.617869 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:09:30.618059 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:30.760251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:30.760423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:30.946952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.534s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:30.947265 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:09:30.949449 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.532s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:31.122132 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:31.262597 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Detaching volume 3b576f1e-7833-4ab1-b6cd-32e301debab8
May 26 05:09:31.300677 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Attempting to driver detach volume 3b576f1e-7833-4ab1-b6cd-32e301debab8 from mountpoint /dev/vdb
May 26 05:09:31.304369 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Found disk vdb by alias ua-3b576f1e-7833-4ab1-b6cd-32e301debab8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:09:31.305692 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Found disk vdb by alias ua-3b576f1e-7833-4ab1-b6cd-32e301debab8 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:09:31.305806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Attempting to detach device vdb from instance b71f2db5-8f92-4400-bf45-634f9790fca0 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:09:31.306282 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <alias name="ua-3b576f1e-7833-4ab1-b6cd-32e301debab8"/>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <serial>3b576f1e-7833-4ab1-b6cd-32e301debab8</serial>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:31.306282 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:09:31.310578 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully detached device vdb from instance b71f2db5-8f92-4400-bf45-634f9790fca0 from the persistent domain config.
May 26 05:09:31.310737 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] (1/8): Attempting to detach device vdb with device alias ua-3b576f1e-7833-4ab1-b6cd-32e301debab8 from instance b71f2db5-8f92-4400-bf45-634f9790fca0 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:09:31.311038 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <alias name="ua-3b576f1e-7833-4ab1-b6cd-32e301debab8"/>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <serial>3b576f1e-7833-4ab1-b6cd-32e301debab8</serial>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:31.311038 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:09:31.452867 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:09:31.453676 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:09:31.454635 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:31.454852 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:31.504252 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:31.504768 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:31.558689 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5137ef274a4a94a48962027c45d899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23047976f3814538912524932a6a9375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:09:31.924593 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772171.924244, b71f2db5-8f92-4400-bf45-634f9790fca0 => ua-3b576f1e-7833-4ab1-b6cd-32e301debab8> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:09:31.925224 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3b576f1e-7833-4ab1-b6cd-32e301debab8 for instance b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:09:31.927390 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully detached device vdb from instance b71f2db5-8f92-4400-bf45-634f9790fca0 from the live domain config.
May 26 05:09:31.928955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:31.928955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:31.928955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:31.929411 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:31.929831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b576f1e-7833-4ab1-b6cd-32e301debab8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:31.930101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:31.954518 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsi session list stdout=tcp: [114] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [115] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8 (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:31.964639 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '114'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '115'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:31.964639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '114')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:31.969485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8', '115')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:31.969485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46da5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:31.969485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Removing multipathed devices sdf, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:09:31.969485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Flush multipath device 3300000009a63321e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:09:32.008294 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:32.016130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:32.066380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:32.074435 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Successfully created port: e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:09:32.078305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:32.114885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Checking to see if SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:09:32.115157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] SCSI volumes sdf, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:09:32.116573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Checking to see if device paths {'sdf', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:09:32.128305 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Device paths {'sdf', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:09:32.128518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:32.139895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.178585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 114, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.40.100,3260]
May 26 05:09:32.178585 np0000001388 nova-compute[98319]: Logout of [sid: 114, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.40.100,3260] successful.
May 26 05:09:32.178585 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.196434 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.208265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.239533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 115, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.50.100,3260]
May 26 05:09:32.239533 np0000001388 nova-compute[98319]: Logout of [sid: 115, target: iqn.2023-03.storpool.com:os--volume-3b576f1e-7833-4ab1-b6cd-32e301debab8, portal: 192.168.50.100,3260] successful.
May 26 05:09:32.239533 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.258172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:32.258483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:32.258583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] <== disconnect_volume: return (329ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:32.258748 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:32.413810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:32.457832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:09:32.516481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.567s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:32.518101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.396s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:32.519179 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:32.519396 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:09:32.577806 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance 67e6c789-cd47-4a9d-85a4-3c51faa4d646
May 26 05:09:32.591581 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Successfully updated port: e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:09:32.640758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-changed-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:32.640942 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Refreshing instance network info cache due to event network-changed-e8eb467c-d9ba-479d-8ee0-69d560625bac. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:09:32.641301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] Acquiring lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:32.641301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] Acquired lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:32.641492 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Refreshing network info cache for port e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:09:32.811894 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'flavor' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:33.076385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:33.076539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:33.076676 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Shelve offloading
May 26 05:09:33.094107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:33.145121 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:33.204665 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:09:33.336278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:33.465447 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:09:33.466328 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:09:33.466578 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Creating image(s)
May 26 05:09:33.467155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:33.467155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:33.467641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:33.468638 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:09:33.471747 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:09:33.473049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.565436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.578444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.579146 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:33.589208 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.010s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:33.590874 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:09:33.595042 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:09:33.595857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-83b6587f-c23d-4161-b604-045a843bd226 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "67e6c789-cd47-4a9d-85a4-3c51faa4d646" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.866s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:33.598378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.663002 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.663580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.687780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.688481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.744120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk 1073741824" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.744673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:33.745026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.758532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.759240 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:09:33.765659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.819159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086fd62b-896e-4ad6-8af9-ff6a255e29ee tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.058s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:33.833894 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.834382 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:09:33.834709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.847929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7f654b1d-f230-4db4-9f36-feb8e78f0078 req-d65e4029-719c-437b-aa2f-8fa929738eb8 service nova] Releasing lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:33.849403 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquired lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:33.852334 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:09:33.859931 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.860674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:33.924607 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.925885 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Cannot resize image /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:09:33.926360 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:09:33.926606 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Ensure instance console log exists: /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:09:33.927131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:33.927464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:33.927650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:33.955777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:33.960013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.024959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.025217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:34.025459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.025629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:34.025793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:34.028512 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Terminating instance
May 26 05:09:34.045422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.045837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.132164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.133437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.137852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.151296 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.159803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.178831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.183904 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.228275 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.228769 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.274564 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0011735190000763396 future=<Future at 0x7d7aa445aa50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.274716 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.274878 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.289867183000297 future=<Future at 0x7d7ac411d250 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.275002 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.289738743000271 future=<Future at 0x7d7ac411d250 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.275726 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772159.273228, 7583fee2-acf9-4217-ad23-adca4ec3e186 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:34.276951 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] VM Stopped (Lifecycle Event)
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:34.282095 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-27eb9ca8-a038-4058-9eb0-08ec99d56795 req-2aa40bf1-d812-4592-ac0c-906f29ff51b2 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received unexpected event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with vm_state active and task_state shelving.
May 26 05:09:34.334427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.337587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-7 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:09:34.339471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.406428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.406730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:34.426681 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:09:34.432702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.433305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.464136 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99781658899974 future=<Future at 0x7d7aa43a0620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.468241 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance destroyed successfully.
May 26 05:09:34.469229 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'numa_topology' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:34.506773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.531305 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:34.532057 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.535221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.559435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.581063 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.642394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.642939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.699426 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:34.724476 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b92a6a5e-a751-4712-9202-0db2557cca80 req-b6865bb2-cfac-4454-ac79-828f4e4c509c service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:34.734114 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.737458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk.rescue --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.738239 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.755835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:34.784581 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 7583fee2-acf9-4217-ad23-adca4ec3e186] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:34.836871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.837676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.883528 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998050517000138 future=<Future at 0x7d7aa445b1a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:34.885610 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Instance destroyed successfully.
May 26 05:09:34.886633 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid b71f2db5-8f92-4400-bf45-634f9790fca0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:34.916140 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Detaching volume 0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c
May 26 05:09:34.938911 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updating instance_info_cache with network_info: [{"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:34.951970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:34.956857 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:09:34.959298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:34.976972 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Attempting to driver detach volume 0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c from mountpoint /dev/vdb
May 26 05:09:34.980968 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:34.989570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:34.989728 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:34.990810 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:09:34.996390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found disk vdb by alias ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:09:34.997966 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Found disk vdb by alias ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:09:34.998136 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Attempting to detach device vdb from instance c6482b32-d458-4461-81de-fce59c1732fd from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:09:34.998579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <alias name="ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c"/>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <serial>0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c</serial>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:34.998579 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:09:35.006626 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully detached device vdb from instance c6482b32-d458-4461-81de-fce59c1732fd from the persistent domain config.
May 26 05:09:35.007077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] (1/8): Attempting to detach device vdb with device alias ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c from instance c6482b32-d458-4461-81de-fce59c1732fd from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:09:35.007459 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <alias name="ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c"/>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-5"/>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <serial>0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c</serial>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]: </disk>
May 26 05:09:35.007459 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:09:35.067756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:35.067966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:35.103265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:35.103584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:35.103853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:35.104042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:35.104134 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:35.108553 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Terminating instance
May 26 05:09:35.180022 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:35.180972 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-5 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:09:35.185183 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:09:35.185183 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:35.235297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.050s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:35.235766 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=11239MB free_disk=72.7696647644043GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:09:35.235944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:35.236251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:35.396995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:07:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-408518215',display_name='tempest-ServerRescueNegativeTestJSON-server-408518215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-408518215',id=43,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQA5euGQIXjkEDpFcEJt5fV8GhcPsOhTy6qROxtoGZT8rOzobviV08JWyiVPQbnrIuo7DyUwthH2j6fP9r4K+SNbTVM//Rx8D59+kVPF36sliDmpGym7Xb3zJg4hvy1fA==',key_name='tempest-keypair-1240985616',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:45Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-m99l0iin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:08:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f0799194be46487e89960ac774578992',uuid=b71f2db5-8f92-4400-bf45-634f9790fca0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:35.396995 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "address": "fa:16:3e:14:7a:24", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa4d215b-14", "ovs_interfaceid": "fa4d215b-14db-4e8f-9be5-2be67ea1745d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:35.396995 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:35.396995 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:35.401552 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.401933 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa4d215b-14, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:35.405000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:35.409195 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.410737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.410946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ce3cca7-88be-43f9-935d-9f573cb3fec8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:35.411919 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.412188 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:35.416943 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.418774 np0000001388 nova-compute[98319]: INFO os_vif [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:7a:24,bridge_name='br-int',has_traffic_filtering=True,id=fa4d215b-14db-4e8f-9be5-2be67ea1745d,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa4d215b-14')
May 26 05:09:35.419069 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Deleting instance files /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0_del
May 26 05:09:35.419789 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Deletion of /opt/stack/data/nova/instances/b71f2db5-8f92-4400-bf45-634f9790fca0_del complete
May 26 05:09:35.443849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Releasing lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:35.444359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance network_info: |[{"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:09:35.446914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Start _get_guest_xml network_info=[{"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:09:35.451187 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:09:35.452567 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1208937757', uuid='a74c18c3-b0c2-43f4-abed-449a83e9eff0'), owner=OwnerMeta(userid='3a5137ef274a4a94a48962027c45d899', username='tempest-AttachVolumeNegativeTest-1739279332-project-member', projectid='23047976f3814538912524932a6a9375', projectname='tempest-AttachVolumeNegativeTest-1739279332'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772175.4519818) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:09:35.454377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:09:35.454873 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:09:35.456112 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:09:35.456371 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:09:35.457753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:09:35.458237 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:09:35.458931 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:09:35.459094 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:09:35.459352 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:09:35.459508 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:09:35.459678 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:09:35.459928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:09:35.460107 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:09:35.460323 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:09:35.460516 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:09:35.460711 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:09:35.475814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1208937757',display_name='tempest-AttachVolumeNegativeTest-server-1208937757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1208937757',id=48,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8a52Km4N7Bwb9yUh/cHOljMsrXU1FHzjbkJ+OpIwPIjECuIpJlvuV3FWc1Z2cx4RWOd+wZWF3vN9ZtJqRtudk6JGQNUFnBPe/jQYqQUIiRsEYfK6989z/CUIm9oiTWkA==',key_name='tempest-keypair-1416872007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-7yh8ny4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=a74c18c3-b0c2-43f4-abed-449a83e9eff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:09:35.476259 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:35.476532 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:35.477087 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'pci_devices' on Instance uuid a74c18c3-b0c2-43f4-abed-449a83e9eff0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:35.495788 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:35.572218 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772175.5718532, c6482b32-d458-4461-81de-fce59c1732fd => ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:09:35.573097 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c for instance c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:09:35.575378 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully detached device vdb from instance c6482b32-d458-4461-81de-fce59c1732fd from the live domain config.
May 26 05:09:35.576211 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:35.576604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:35.576747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:35.577117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:35.577432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:35.577556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [127] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [128] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:35.605700 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:35.605700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '127'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '128'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:35.606338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '127')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:35.606981 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', '128')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:35.607732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa434d4e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:35.607934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Removing multipathed devices sdk, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:09:35.608151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Flush multipath device 330000000b4866d25 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:09:35.614128 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:35.639337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:35.639793 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.642070 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.664432 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.697154 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:35.754528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking to see if SCSI volumes sdk, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:09:35.754528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] SCSI volumes sdk, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:09:35.755959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Checking to see if device paths {'sdk', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:09:35.769112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Device paths {'sdk', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:09:35.769498 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:35.781460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.801979 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.811501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.816731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 127, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.40.100,3260]
May 26 05:09:35.816731 np0000001388 nova-compute[98319]: Logout of [sid: 127, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.40.100,3260] successful.
May 26 05:09:35.816731 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.831990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.843020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.873563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 128, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.50.100,3260]
May 26 05:09:35.873563 np0000001388 nova-compute[98319]: Logout of [sid: 128, target: iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, portal: 192.168.50.100,3260] successful.
May 26 05:09:35.873563 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.892137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:35.892539 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:35.893015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== disconnect_volume: return (316ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:35.893015 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:35.912237 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:35.932793 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:09:35.933829 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:35.934214 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:35.934491 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:35.934755 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:35.941866 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999669963000088 future=<Future at 0x7d7aa437f3e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:35.943612 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Instance destroyed successfully.
May 26 05:09:35.944233 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid a921deec-f5fe-4c81-a5c2-df30f947a826 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:35.980225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] End _get_guest_xml xml=<domain type="qemu">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <uuid>a74c18c3-b0c2-43f4-abed-449a83e9eff0</uuid>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <name>instance-00000030</name>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1208937757</nova:name>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:09:35</nova:creationTime>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:user uuid="3a5137ef274a4a94a48962027c45d899">tempest-AttachVolumeNegativeTest-1739279332-project-member</nova:user>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:project uuid="23047976f3814538912524932a6a9375">tempest-AttachVolumeNegativeTest-1739279332</nova:project>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         <nova:port uuid="e8eb467c-d9ba-479d-8ee0-69d560625bac">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.5" ipVersion="4"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <system>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="serial">a74c18c3-b0c2-43f4-abed-449a83e9eff0</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="uuid">a74c18c3-b0c2-43f4-abed-449a83e9eff0</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </system>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <os>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </os>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <features>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </features>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   <devices>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </disk>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.config"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </disk>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:4a:bf:d0"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <target dev="tape8eb467c-d9"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </interface>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/console.log" append="off"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </serial>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <video>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </video>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </rng>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:   </devices>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]: </domain>
May 26 05:09:35.980225 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:09:35.980225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Preparing to wait for external event network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:09:35.980225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:35.980225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:35.982229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:35.982229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1208937757',display_name='tempest-AttachVolumeNegativeTest-server-1208937757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1208937757',id=48,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8a52Km4N7Bwb9yUh/cHOljMsrXU1FHzjbkJ+OpIwPIjECuIpJlvuV3FWc1Z2cx4RWOd+wZWF3vN9ZtJqRtudk6JGQNUFnBPe/jQYqQUIiRsEYfK6989z/CUIm9oiTWkA==',key_name='tempest-keypair-1416872007',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-7yh8ny4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:09:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=a74c18c3-b0c2-43f4-abed-449a83e9eff0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:09:35.982229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:35.982229 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:35.982229 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:09:35.982593 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.982736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:35.982910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:09:35.983629 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.983747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7a8b721-e1c3-5904-8df6-11e8e8fa95b6', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:35.985149 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:35.987160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:35.997809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.000019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.000231 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8eb467c-d9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:36.000593 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8eb467c-d9, col_values=(('qos', UUID('5971b03a-0830-4020-91dd-4b0ce9c37eb8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:36.000773 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8eb467c-d9, col_values=(('external_ids', {'iface-id': 'e8eb467c-d9ba-479d-8ee0-69d560625bac', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:bf:d0', 'vm-uuid': 'a74c18c3-b0c2-43f4-abed-449a83e9eff0'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:36.001696 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.002963 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:36.019674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.023412 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:36.025347 np0000001388 nova-compute[98319]: INFO os_vif [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9')
May 26 05:09:36.114243 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:36.313397 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.313521 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 21be2726-991c-4d86-971a-d2033d23977b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.313664 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a921deec-f5fe-4c81-a5c2-df30f947a826 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.313719 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance debb889d-e74c-4caa-b278-826a5ed536e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.313827 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 258b4ab0-7d70-4714-b0a8-a1827592acad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.313995 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance b71f2db5-8f92-4400-bf45-634f9790fca0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.314131 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 013b0bd1-140e-45dc-a5fa-73f702d59332 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.314243 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c6482b32-d458-4461-81de-fce59c1732fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.314357 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c390c1f4-d1aa-446a-93c7-43417d742588 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.314441 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance a74c18c3-b0c2-43f4-abed-449a83e9eff0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:09:36.314675 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:09:36.314802 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:09:35 up 41 min,  2 users,  load average: 5.55, 6.70, 4.69\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '5', 'num_os_type_None': '10', 'num_proj_056a9cea608647fda5cc210009e4e5fc': '3', 'io_workload': '1', 'num_task_deleting': '3', 'num_proj_68b22c1abf2f4ba788005f454c7f8add': '3', 'num_vm_rescued': '1', 'num_proj_23047976f3814538912524932a6a9375': '2', 'num_proj_59c0c90d3ca84a4bb5aaf3f1c8245e23': '1', 'num_task_shelving': '1', 'num_proj_46d0ca59fdff45d28366bc7eaf9071dc': '1', 'num_vm_building': '1', 'num_task_spawning': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:09:36.374034 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:36.374881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:36.374881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:36.374881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:36.374996 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:36.375175 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received unexpected event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with vm_state active and task_state shelving.
May 26 05:09:36.375381 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:36.375544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:36.375725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:36.376152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:36.376152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] No waiting events found dispatching network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:36.376152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:36.376360 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:36.376552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Acquiring lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:36.376726 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:36.377088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:36.377306 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] No waiting events found dispatching network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:36.377501 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc16e59d-adf3-4690-a5c5-9258809577b4 req-06b9e625-b39f-4d72-9951-eb02f2a8c729 service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-unplugged-5decd3eb-d9e7-472e-b37b-ac70248fe91b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:36.444733 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'flavor' on Instance uuid c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:36.446701 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:04:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-1',id=33,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:55Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-a26ekxzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=a921deec-f5fe-4c81-a5c2-df30f947a826,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:36.446863 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "address": "fa:16:3e:ea:3c:2e", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap5decd3eb-d9", "ovs_interfaceid": "5decd3eb-d9e7-472e-b37b-ac70248fe91b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:36.449368 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:36.449653 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:36.455375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.455375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5decd3eb-d9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:36.455375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.455375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:36.468726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.470901 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.471613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff23258f-4a00-4998-a05c-11728624d38c) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:36.474343 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:36.482644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:36.486588 np0000001388 nova-compute[98319]: INFO os_vif [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ea:3c:2e,bridge_name='br-int',has_traffic_filtering=True,id=5decd3eb-d9e7-472e-b37b-ac70248fe91b,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5decd3eb-d9')
May 26 05:09:36.486892 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Deleting instance files /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826_del
May 26 05:09:36.487695 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Deletion of /opt/stack/data/nova/instances/a921deec-f5fe-4c81-a5c2-df30f947a826_del complete
May 26 05:09:36.616518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:36.616745 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:36.616928 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:36.781317 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:36.781664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] Acquiring lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:36.781881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:36.782315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:36.782512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] No waiting events found dispatching network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:36.782637 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d2a87ce3-f017-40cd-bce0-0c131b6ea399 req-4ad6f936-4d6d-4414-b0c9-b2cd766963b3 service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-unplugged-fa4d215b-14db-4e8f-9be5-2be67ea1745d for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:36.810167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:36.810528 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:36.972320 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:36.992814 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Took 1.38 seconds to destroy the instance on the hypervisor.
May 26 05:09:36.993437 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:36.993753 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:36.993906 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:36.994229 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:37.061978 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance destroyed successfully.
May 26 05:09:37.062461 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'resources' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:37.098102 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:37.105881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:37.106949 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing instance network info cache due to event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:09:37.107107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:37.107251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:37.107367 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:09:37.313553 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:37.428638 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.457454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c76a4885-a033-4b61-ade0-c9bc0a7665bf tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.051s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:37.458554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.953s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:37.458930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:37.459187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:37.459419 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:37.461864 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Terminating instance
May 26 05:09:37.473942 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Took 1.54 seconds to deallocate network for instance.
May 26 05:09:37.542162 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:37.542613 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:37.542613 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:4a:bf:d0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:09:37.543082 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Using config drive
May 26 05:09:37.564618 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Object Instance<c390c1f4-d1aa-446a-93c7-43417d742588> lazy-loaded attributes: numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:09:37.565032 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrckk/r+WkT3AexHRfVCeISlqf2otyD3FzNcz6REARM00TA/PMkVHdRUj+2YqtchX2kG0Oag/lSUhJKOIIV+GNU5kVNqLRneKasaCRLw3CAHtT6Sfd4/IM8jSkU8L2cAQ==',key_name='tempest-TestShelveInstance-209725618',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:52Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:08:52Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:37.565250 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:37.565706 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:37.566323 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:37.567808 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.568150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33ef0430-8f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:37.569434 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.570417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:37.576827 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.577996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.578182 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4bbfaee-7a34-4fd4-8dad-5e34e0b95931) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:37.578765 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.579374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:37.584508 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.586832 np0000001388 nova-compute[98319]: INFO os_vif [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f')
May 26 05:09:37.588423 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:37.588772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:37.588951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:37.589416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:37.589780 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:37.589967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:37.609262 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:37.620626 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [117] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: tcp: [118] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:37.620993 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:37.621217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '117'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '118'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:37.621304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '117')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:37.622923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '118')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:37.623982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4443380>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:37.624248 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Removing multipathed devices sdb, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:09:37.624533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flush multipath device 3300000004cda2c44 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:09:37.678824 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:37.719090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:37.761443 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Checking to see if SCSI volumes sdb, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:09:37.762291 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] SCSI volumes sdb, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:09:37.763435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Checking to see if device paths {'sdb', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:09:37.774965 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Device paths {'sdb', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:09:37.775182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:37.787452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.820280 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:09:37.820567 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.584s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:37.821116 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:37.829596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 117, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260]
May 26 05:09:37.829596 np0000001388 nova-compute[98319]: Logout of [sid: 117, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260] successful.
May 26 05:09:37.829596 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.846122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.851983 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:37.856909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.886419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260]
May 26 05:09:37.886419 np0000001388 nova-compute[98319]: Logout of [sid: 118, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260] successful.
May 26 05:09:37.886419 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.900899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:37.901312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:37.901487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== disconnect_volume: return (312ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:37.902222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:37.902222 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deleting instance files /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588_del
May 26 05:09:37.902929 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deletion of /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588_del complete
May 26 05:09:37.967893 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:37.971581 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:37.980944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:37.981150 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:37.989679 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:37.993108 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.011396 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.014223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.033158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.044592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.048948 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:38.160290 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updated VIF entry in instance network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:09:38.160700 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": null, "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap33ef0430-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:38.239776 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Creating config drive at /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.config
May 26 05:09:38.245605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpafmy9_wq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:38.306181 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999484376000055 future=<Future at 0x7d7aa444b110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:38.308330 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Instance destroyed successfully.
May 26 05:09:38.309613 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpafmy9_wq" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:38.310253 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lazy-loading 'resources' on Instance uuid c6482b32-d458-4461-81de-fce59c1732fd {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:38.355597 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Took 1.36 seconds to deallocate network for instance.
May 26 05:09:38.447636 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Received event network-vif-deleted-fa4d215b-14db-4e8f-9be5-2be67ea1745d {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:38.448423 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:38.448742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:38.449033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:38.449311 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:38.449452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] No waiting events found dispatching network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:38.449654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:38.449838 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:38.450039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Acquiring lock "c6482b32-d458-4461-81de-fce59c1732fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:38.450574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:38.451472 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] Lock "c6482b32-d458-4461-81de-fce59c1732fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:38.451635 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] No waiting events found dispatching network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:38.451762 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5251041-353c-4a4d-9317-b1446f328c96 req-12f9038d-9174-49b5-985d-43202adb43ed service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-unplugged-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:38.603591 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:38.603978 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:38.662797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e02af98f-fb05-48fc-9706-20b14c7a5be3 req-cd2dac9f-0bd6-4da8-ac10-aa73611129ff service nova] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:38.704500 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:09:38.704801 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 48.91 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:38.793746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.814391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-121177492',display_name='tempest-VolumesSnapshotTestJSON-instance-121177492',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumessnapshottestjson-instance-121177492',id=45,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNCWY7pgVnBIAJVFwXn6cnmoldZCcOjb4fhqLeAEAfwa414k2J8efAd4uVw0j9ZB/DnAd+I3cOYGb0uEGcae1BWlxxr7RNtWcUkM/sNuHK8TKyvqYzHuBxm9VJNNA0cG4w==',key_name='tempest-keypair-1318343605',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:39Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59c0c90d3ca84a4bb5aaf3f1c8245e23',ramdisk_id='',reservation_id='r-39tb5gvd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-805170533',owner_user_name='tempest-VolumesSnapshotTestJSON-805170533-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:08:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e5c64df40bd44d89d8f1617f4fa5281',uuid=c6482b32-d458-4461-81de-fce59c1732fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:38.814568 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converting VIF {"id": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "address": "fa:16:3e:e8:89:65", "network": {"id": "435da0ed-4394-48d7-908a-06a1f0e83d0d", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1205044501-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "59c0c90d3ca84a4bb5aaf3f1c8245e23", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8226de6f-ae", "ovs_interfaceid": "8226de6f-ae4b-43c9-9d6a-6d0388a2e3be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:38.815244 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:38.815511 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:38.816983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.817360 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8226de6f-ae, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:38.819158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.820412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:38.823023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.825411 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.825551 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b087d1a7-08b9-4d1a-9fc5-b8600b972708) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:38.826666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:38.827366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.828963 np0000001388 nova-compute[98319]: INFO os_vif [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:89:65,bridge_name='br-int',has_traffic_filtering=True,id=8226de6f-ae4b-43c9-9d6a-6d0388a2e3be,network=Network(435da0ed-4394-48d7-908a-06a1f0e83d0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8226de6f-ae')
May 26 05:09:38.830936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:38.831374 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:38.831545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:38.831839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:38.832115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:38.832297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:38.852361 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a3920d31-07ed-4b3a-b7bc-96fc36682722 req-24fb78c8-7f9a-4f75-8317-12ce5108fb3b service nova] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Received event network-vif-deleted-5decd3eb-d9e7-472e-b37b-ac70248fe91b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:38.857765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:38.857765 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:38.857765 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:38.857765 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:38.857765 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:38.858507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:38.858507 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:38.858507 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:38.858507 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:38.858507 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:38.859258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:38.859258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:38.859258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:09:38.859258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c, 0): [] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:38.859258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0aae9c54-6cb2-4a7f-bc63-76f65b2dce7c') {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}}
May 26 05:09:38.859454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46dbc40>, {}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:38.860235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Disconnecting from: [] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:38.860235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:38.860520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] <== disconnect_volume: return (28ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:38.860739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:38.861269 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Deleting instance files /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd_del
May 26 05:09:38.862234 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Deletion of /opt/stack/data/nova/instances/c6482b32-d458-4461-81de-fce59c1732fd_del complete
May 26 05:09:38.866495 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:38.910814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.967133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:38.968441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:39.107508 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:39.169175 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:39.169689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:39.169946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:39.170131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:39.170333 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Processing event network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:09:39.170568 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:39.170761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:39.170934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:39.171077 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:39.171258 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] No waiting events found dispatching network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:39.171439 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-329e01ce-c3e3-452d-91a0-e262067d6236 req-1c09f67c-64ab-4d21-93f4-525fdf6c0060 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received unexpected event network-vif-plugged-e8eb467c-d9ba-479d-8ee0-69d560625bac for instance with vm_state building and task_state spawning.
May 26 05:09:39.371260 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:09:39.373861 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:39.374280 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:39.374399 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:39.375391 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:39.478281 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:39.541548 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772179.5409734, a74c18c3-b0c2-43f4-abed-449a83e9eff0 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:39.541788 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] VM Started (Lifecycle Event)
May 26 05:09:39.542619 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:09:39.546794 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:09:39.548819 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance spawned successfully.
May 26 05:09:39.549250 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:09:39.601478 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Deleted allocations for instance c390c1f4-d1aa-446a-93c7-43417d742588
May 26 05:09:39.614578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.633s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:39.616378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.748s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:39.687882 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Deleted allocations for instance b71f2db5-8f92-4400-bf45-634f9790fca0
May 26 05:09:40.044910 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:40.047853 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:09:40.055741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.055927 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.056509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.056803 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.057111 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.057452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:09:40.089711 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:40.089933 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:40.106112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:40.391038 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:40.538394 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c841ed44-3076-49a9-90bb-7e3bfa73da8c req-ff2c6215-cf2a-4201-8e0a-d9716d86ac23 service nova] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Received event network-vif-deleted-8226de6f-ae4b-43c9-9d6a-6d0388a2e3be {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:40.553610 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:09:40.553968 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772180.5537217, a74c18c3-b0c2-43f4-abed-449a83e9eff0 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:40.554146 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] VM Paused (Lifecycle Event)
May 26 05:09:40.564149 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Took 7.10 seconds to spawn the instance on the hypervisor.
May 26 05:09:40.564336 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:40.593740 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:40.699015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b31aa4db-18d0-49b0-9d84-25d654f09ba9 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "b71f2db5-8f92-4400-bf45-634f9790fca0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.674s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:40.893157 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Took 1.52 seconds to deallocate network for instance.
May 26 05:09:40.912853 np0000001388 nova-compute[98319]: WARNING nova.volume.cinder [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Attachment 2b0cd432-bce5-45f8-beca-ada752b6515b does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 2b0cd432-bce5-45f8-beca-ada752b6515b. (HTTP 404) (Request-ID: req-77ec1b50-a958-4dea-9224-f5083bc9f5b2)
May 26 05:09:40.913133 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Took 0.02 seconds to detach 1 volumes for instance.
May 26 05:09:41.056739 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:41.058581 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772181.0583305, a74c18c3-b0c2-43f4-abed-449a83e9eff0 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:41.058690 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] VM Resumed (Lifecycle Event)
May 26 05:09:41.075580 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Took 12.72 seconds to build instance.
May 26 05:09:41.103116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.488s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:41.104104 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.998s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:41.167975 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance a921deec-f5fe-4c81-a5c2-df30f947a826
May 26 05:09:41.311863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:41.418487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:41.539995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:41.540177 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:41.561438 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:41.563384 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:09:41.565157 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003894239998771809 future=<Future at 0x7d7ac411d250 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:41.565964 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772166.5646741, 67e6c789-cd47-4a9d-85a4-3c51faa4d646 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:41.566149 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:41.566401 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] VM Stopped (Lifecycle Event)
May 26 05:09:41.567210 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.89451840699985 future=<Future at 0x7d7aa43a0620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:41.567335 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.8943709810000655 future=<Future at 0x7d7aa43a0620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:41.577477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b59d0130-9bc1-4509-8d64-cfa662e8bcfd tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.228s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:41.883574 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:09:42.043062 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:42.070736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 67e6c789-cd47-4a9d-85a4-3c51faa4d646] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:42.176060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-292ec9bd-cb4f-40a1-882b-93c2fb867661 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "a921deec-f5fe-4c81-a5c2-df30f947a826" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.073s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:42.430732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:42.553391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.449s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:42.556635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:42.618205 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-changed-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:42.618414 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Refreshing instance network info cache due to event network-changed-e8eb467c-d9ba-479d-8ee0-69d560625bac. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:09:42.618632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] Acquiring lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:42.618773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] Acquired lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:42.620041 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Refreshing network info cache for port e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:09:42.997319 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:42.997674 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:43.059650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6da5aba9-d630-4347-8271-ed504fd7a51b tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 9.983s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:43.061209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 1.748s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:43.061453 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Unshelving
May 26 05:09:43.122220 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:43.359817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:43.359963 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:43.360131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:43.360698 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:43.360825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:43.362753 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Terminating instance
May 26 05:09:43.417314 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:43.500133 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:43.590611 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updated VIF entry in instance network info cache for port e8eb467c-d9ba-479d-8ee0-69d560625bac. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:09:43.591093 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updating instance_info_cache with network_info: [{"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:43.805572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:43.805850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:43.806091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:43.806332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:43.806521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:43.810104 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Terminating instance
May 26 05:09:43.827259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:43.865687 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:43.885835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:43.888496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:43.908592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.009013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.452s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:44.033858 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:44.033858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:44.033858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:44.033858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:44.034498 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] No waiting events found dispatching network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:44.034849 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5467482d-2521-4d1d-ab14-54bd2f23d613 req-cbb90554-e71e-47d4-93c2-a1c11f5fdd45 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:44.076072 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Booting with volume 2c927b41-d2a6-4c61-bb16-42ff4b045c1c at /dev/vda
May 26 05:09:44.084491 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.091008 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Deleted allocations for instance c6482b32-d458-4461-81de-fce59c1732fd
May 26 05:09:44.094134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.096188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38500a49-7adc-41ec-9f93-1bc861dd826b req-17b1a5b2-670b-46c4-95d9-a730a38fd1fb service nova] Releasing lock "refresh_cache-a74c18c3-b0c2-43f4-abed-449a83e9eff0" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:44.134009 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:44.151555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:09:44.167435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.178680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:44.178991 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.202862 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99893609100036 future=<Future at 0x7d7ac441bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:44.205244 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Instance destroyed successfully.
May 26 05:09:44.206982 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid 21be2726-991c-4d86-971a-d2033d23977b {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:44.223496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:09:44.223757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:09:44.231323 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:09:44.232637 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fea4:35e8', 'fe80::2cbc:b4ff:fedf:ad58', 'fe80::a841:6eff:fe5b:7c15', 'fe80::fc16:3eff:fede:bf10', 'fe80::fc16:3eff:fe9d:f6c', 'fe80::fc16:3eff:fe39:fdac', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:fe4a:bfd0'] 
May 26 05:09:44.233021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:09:44.233140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:09:44.233438 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:44.233623 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating existing volume attachment record: e82bceaa-bb68-4939-babc-5f6624565d18 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:09:44.315333 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:44.339744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.367794 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.499745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.510982 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.652751 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999726359000306 future=<Future at 0x7d7aa44483e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:44.653983 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Instance destroyed successfully.
May 26 05:09:44.654504 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid 258b4ab0-7d70-4714-b0a8-a1827592acad {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:44.714040 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:04:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='multiattach-server-0',id=32,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU78G0pulFOp1BFTzu3yhxix1bt/B06OMHZyx/3xzR1LNhnAU7Ce9hLU/7mRjNi6wiGwJChQYlEwXCrUk7fnCLELL9vpT7N1AStKJGMp/076tOssOG2LUBEG+ptrGvEvQ==',key_name='tempest-keypair-1395672736',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:39Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-u60h5m91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60d48ed701e84f978f7e0559581a07c1',uuid=21be2726-991c-4d86-971a-d2033d23977b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:44.714369 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "address": "fa:16:3e:22:1b:83", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdc13fc7e-fb", "ovs_interfaceid": "dc13fc7e-fb16-41c7-864b-b68f89d55b7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:44.714913 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:44.715152 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:44.716300 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.716503 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdc13fc7e-fb, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:44.718657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:44.723110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.724430 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.724685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b44a962-6fe4-4056-901a-044c38e050ec) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:44.725601 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.726257 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:44.730860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:44.732841 np0000001388 nova-compute[98319]: INFO os_vif [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:1b:83,bridge_name='br-int',has_traffic_filtering=True,id=dc13fc7e-fb16-41c7-864b-b68f89d55b7e,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdc13fc7e-fb')
May 26 05:09:44.733109 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Deleting instance files /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b_del
May 26 05:09:44.733857 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Deletion of /opt/stack/data/nova/instances/21be2726-991c-4d86-971a-d2033d23977b_del complete
May 26 05:09:45.103210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8e975c86-1c20-40d1-8828-9ee34f78ee65 tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Lock "c6482b32-d458-4461-81de-fce59c1732fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.645s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:45.156959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-793598710',display_name='tempest-ServerRescueNegativeTestJSON-server-793598710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-793598710',id=41,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-kuru2plv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:07:05Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=258b4ab0-7d70-4714-b0a8-a1827592acad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:45.157245 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "864a6c86-884c-476f-986c-54dbab598b27", "address": "fa:16:3e:de:bf:10", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap864a6c86-88", "ovs_interfaceid": "864a6c86-884c-476f-986c-54dbab598b27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:45.157878 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:45.158124 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:45.159081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:45.159359 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap864a6c86-88, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:45.162003 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:45.162624 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:45.162792 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7d051ff-8e43-4ed1-806b-ad32b98e3b01) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:45.164401 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:45.167697 np0000001388 nova-compute[98319]: INFO os_vif [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:bf:10,bridge_name='br-int',has_traffic_filtering=True,id=864a6c86-884c-476f-986c-54dbab598b27,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap864a6c86-88')
May 26 05:09:45.168024 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Deleting instance files /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad_del
May 26 05:09:45.169383 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Deletion of /opt/stack/data/nova/instances/258b4ab0-7d70-4714-b0a8-a1827592acad_del complete
May 26 05:09:45.239928 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:09:45.241118 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:45.241307 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:45.241417 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:45.241667 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:45.352252 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:45.675452 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Took 1.36 seconds to destroy the instance on the hypervisor.
May 26 05:09:45.675966 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:45.676353 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:45.676473 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:45.676643 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:45.774720 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:45.884036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:45.884305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:45.886284 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'pci_requests' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:46.020916 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8cdb06be-2413-4d5f-b8e0-91cc68b70bb3 req-b49c9c1f-d569-4b9b-b279-bb3b9c063897 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-deleted-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:46.021528 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-8cdb06be-2413-4d5f-b8e0-91cc68b70bb3 req-b49c9c1f-d569-4b9b-b279-bb3b9c063897 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Neutron deleted interface 864a6c86-884c-476f-986c-54dbab598b27; detaching it from the instance and deleting it from the info cache
May 26 05:09:46.021528 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8cdb06be-2413-4d5f-b8e0-91cc68b70bb3 req-b49c9c1f-d569-4b9b-b279-bb3b9c063897 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:46.057517 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:46.099032 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:46.099452 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Acquiring lock "21be2726-991c-4d86-971a-d2033d23977b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:46.099618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "21be2726-991c-4d86-971a-d2033d23977b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] No waiting events found dispatching network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-unplugged-dc13fc7e-fb16-41c7-864b-b68f89d55b7e for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:46.100255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:46.100463 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:46.100463 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:46.100551 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:46.100656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:46.100741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Acquiring lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:46.100864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:46.100948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:46.101034 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] No waiting events found dispatching network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:46.101123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Received event network-vif-unplugged-864a6c86-884c-476f-986c-54dbab598b27 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:46.101228 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2dd0d7b9-f8fc-42c2-82db-7616ed773dd6 req-722917ce-5885-4c07-b3f5-d95536885168 service nova] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Received event network-vif-deleted-dc13fc7e-fb16-41c7-864b-b68f89d55b7e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:46.390058 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'numa_topology' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:46.472140 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:46.529225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8cdb06be-2413-4d5f-b8e0-91cc68b70bb3 req-b49c9c1f-d569-4b9b-b279-bb3b9c063897 service nova] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Detach interface failed, port_id=864a6c86-884c-476f-986c-54dbab598b27, reason: Instance 258b4ab0-7d70-4714-b0a8-a1827592acad could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:09:46.559870 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Took 1.32 seconds to deallocate network for instance.
May 26 05:09:46.892445 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:09:46.892600 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Claim successful on node np0000001388
May 26 05:09:46.974456 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Took 1.30 seconds to deallocate network for instance.
May 26 05:09:47.066662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:47.432823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:47.479922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:48.268372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:48.268601 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:48.771077 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:49.277573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.393s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:49.278068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.211s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:49.278301 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:49.362835 np0000001388 nova-compute[98319]: INFO nova.network.neutron [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating port 33ef0430-8f05-4754-8e51-b98e306d943f with attributes {'binding:host_id': 'np0000001388', 'device_owner': 'compute:nova'}
May 26 05:09:49.462230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004754300002787204 future=<Future at 0x7d7aa43a0620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.462660 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772174.4615126, c390c1f4-d1aa-446a-93c7-43417d742588 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:49.462806 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Stopped (Lifecycle Event)
May 26 05:09:49.464052 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.464052 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.4173892700000579 future=<Future at 0x7d7aa445b1a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.464052 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.41731708499992237 future=<Future at 0x7d7aa445b1a0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.685906 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:49.686134 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:49.880884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:49.881293 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:49.881293 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:09:49.881846 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000483749000068201 future=<Future at 0x7d7aa445b1a0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.882662 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772174.881214, b71f2db5-8f92-4400-bf45-634f9790fca0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:49.882831 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] VM Stopped (Lifecycle Event)
May 26 05:09:49.883709 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.883995 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.0575994339997123 future=<Future at 0x7d7aa437f3e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.883995 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.0575229109999782 future=<Future at 0x7d7aa437f3e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:49.931520 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:49.931661 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing instance network info cache due to event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:09:49.931766 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:09:49.965346 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:50.164409 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:50.188498 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:50.385428 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:50.387416 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: b71f2db5-8f92-4400-bf45-634f9790fca0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:50.666545 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:50.694896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.417s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:50.696959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 3.215s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:50.773106 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance 21be2726-991c-4d86-971a-d2033d23977b
May 26 05:09:50.830912 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:50.941915 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00037016700025560567 future=<Future at 0x7d7aa437f3e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:50.942499 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772175.9414303, a921deec-f5fe-4c81-a5c2-df30f947a826 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:50.942695 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:50.942935 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] VM Stopped (Lifecycle Event)
May 26 05:09:50.944018 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.361022865999985 future=<Future at 0x7d7aa444b110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:50.944183 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.360829934999856 future=<Future at 0x7d7aa444b110 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:51.170963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:51.171262 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:51.332792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:51.334020 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:09:51.334722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:09:51.335093 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating image(s)
May 26 05:09:51.335656 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:09:51.336746 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:09:51.336941 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Ensure instance console log exists: /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:09:51.337354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:51.337548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:51.337703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:51.338119 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start _get_guest_xml network_info=[{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'e82bceaa-bb68-4939-babc-5f6624565d18', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c390c1f4-d1aa-446a-93c7-43417d742588', 'attached_at': '', 'detached_at': '', 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'serial': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:09:51.340358 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:09:51.341376 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestShelveInstance-server-1521278167', uuid='c390c1f4-d1aa-446a-93c7-43417d742588'), owner=OwnerMeta(userid='0e739c6600d84587806f8d18c8c064f1', username='tempest-TestShelveInstance-917468269-project-member', projectid='46d0ca59fdff45d28366bc7eaf9071dc', projectname='tempest-TestShelveInstance-917468269'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772191.341045) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:09:51.342547 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:09:51.342826 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:09:51.344420 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:09:51.344585 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:09:51.345387 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:09:51.345635 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:09:51.345801 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:09:51.345897 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:09:51.346011 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:09:51.346100 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:09:51.346207 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:09:51.346398 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:09:51.346553 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:09:51.346920 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:09:51.347017 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:09:51.347163 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:09:51.347318 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'vcpu_model' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:51.445595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: a921deec-f5fe-4c81-a5c2-df30f947a826] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:51.674109 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:51.786091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ffa09841-9252-4f15-9013-64dcdb764558 tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "21be2726-991c-4d86-971a-d2033d23977b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.426s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:51.839411 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:51.849363 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Object Instance<c390c1f4-d1aa-446a-93c7-43417d742588> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:09:51.865109 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:09:51.865567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:51.865707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:51.866155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:51.866451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:09:51.880084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:51.880084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:51.880402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:51.880643 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:51.881296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:51.881572 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:51.893485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:51.893485 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:51.899470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:09:51.899470 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:51.913762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c] added
May 26 05:09:51.913762 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:51.913762 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:51.913762 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:51.913762 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:51.913762 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:51.913762 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:51.914136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:51.914185 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:51.914519 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:51.914809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c] added
May 26 05:09:51.914809 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:09:51.914809 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:51.914809 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:51.914809 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:09:51.914809 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:09:51.914809 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:51.915290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:09:51.915290 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0346(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:09:51.915461 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:09:52.139482 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:52.181785 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.486s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:52.241393 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Deleted allocations for instance 258b4ab0-7d70-4714-b0a8-a1827592acad
May 26 05:09:52.295987 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updated VIF entry in instance network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:09:52.296283 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:52.438600 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:52.539779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:52.798558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7b397430-36f8-4f54-adcc-2fa0f2dc57a4 req-f633cc9d-a056-4557-883a-e614e289f8fc service nova] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:09:52.914790 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:09:52.916131 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:52.926861 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:52.926861 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:09:52.933389 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:09:52.933389 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:52.941049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:52.946468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:52.954666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.954666 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.954666 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.954666 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.954666 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:52.954895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.954895 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.954895 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.954895 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.954895 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:52.958436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.958436 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.958436 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.958436 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.958436 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:52.958581 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.958581 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:52.958581 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.958581 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:52.958581 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:52.990062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260]
May 26 05:09:52.990062 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260] successful.
May 26 05:09:52.990062 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:53.001759 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:53.003602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260]
May 26 05:09:53.003602 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260] successful.
May 26 05:09:53.003602 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.017756 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.017979 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:53.019278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:53.019688 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:53.020806 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:53.021288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] HCTL ('7', '-', '-', 0) found on session 131 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:53.022106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:53.043183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching for a device in session 131 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:53.043459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.046109 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:53.046593 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:53.046788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:53.048547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:09:53.048547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] HCTL ('8', '-', '-', 0) found on session 132 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:09:53.048547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:09:53.063289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Searching for a device in session 132 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:09:53.063289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:09:53.152004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:53.152424 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:53.152424 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:53.152948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:53.152948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:53.155986 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Terminating instance
May 26 05:09:53.250499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc144208-ea9c-418e-b931-bca8ed075cdd tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "258b4ab0-7d70-4714-b0a8-a1827592acad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.445s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:53.306230 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00043176899998798035 future=<Future at 0x7d7aa444b110 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:53.306230 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772178.3049347, c6482b32-d458-4461-81de-fce59c1732fd => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:53.306676 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:53.306676 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] VM Stopped (Lifecycle Event)
May 26 05:09:53.308658 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.893915412000297 future=<Future at 0x7d7ac441bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:53.308658 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=5.893652952000139 future=<Future at 0x7d7ac441bd70 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:53.660339 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:53.685453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.687913 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.705744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.708034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.728358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.732968 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.809488 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: c6482b32-d458-4461-81de-fce59c1732fd] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:53.864387 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:53.864387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:53.864387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:53.864387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:53.864629 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] No waiting events found dispatching network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:53.868143 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e0a48a2-f783-447d-9f08-c9163d376288 req-540ce0a4-3dc8-443a-8b34-73265b1d32b7 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:53.882347 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:09:53.951348 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.958727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:53.977013 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99967534299958 future=<Future at 0x7d7ac4445910 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:53.978482 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Instance destroyed successfully.
May 26 05:09:53.978940 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lazy-loading 'resources' on Instance uuid 07d0130e-910b-4ab0-8c20-b2fbde08ac3c {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:54.296071 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:54.296627 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:54.296627 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:54.296627 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:54.296627 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:54.298653 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Terminating instance
May 26 05:09:54.482802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:03:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-1962942053',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumemultiattachtest-server-1962942053',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:04:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='056a9cea608647fda5cc210009e4e5fc',ramdisk_id='',reservation_id='r-vord6rf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeMultiAttachTest-2062276086',owner_user_name='tempest-AttachVolumeMultiAttachTest-2062276086-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:04:22Z,user_data=None,user_id='60d48ed701e84f978f7e0559581a07c1',uuid=07d0130e-910b-4ab0-8c20-b2fbde08ac3c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:54.482997 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converting VIF {"id": "20c312b9-39e6-4c91-a234-2318488c511f", "address": "fa:16:3e:a4:35:e8", "network": {"id": "8903e453-4960-4365-83e2-3ac57c38adcc", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-692771525-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "056a9cea608647fda5cc210009e4e5fc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c312b9-39", "ovs_interfaceid": "20c312b9-39e6-4c91-a234-2318488c511f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:54.483537 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:54.483803 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:54.485770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.485930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20c312b9-39, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:54.486952 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.487636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:54.488907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.489691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.489851 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=219c275b-cb5a-4126-a1ab-b43fdac2d6d1) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:54.491220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:54.494759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.497407 np0000001388 nova-compute[98319]: INFO os_vif [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:35:e8,bridge_name='br-int',has_traffic_filtering=True,id=20c312b9-39e6-4c91-a234-2318488c511f,network=Network(8903e453-4960-4365-83e2-3ac57c38adcc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c312b9-39')
May 26 05:09:54.528622 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:09:54.528960 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:09:54.529129 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:09:54.801714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:09:54.818597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.825213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.845253 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.848349 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.871857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:54.902799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Found WWN 3300000004cda2c44 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:09:54.903301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:54.903731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '3300000004cda2c44', 'path': '/dev/dm-0', 'multipath_id': '3300000004cda2c44'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:54.903944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004cda2c44', 'path': '/dev/dm-0', 'multipath_id': '3300000004cda2c44'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:09:54.904461 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.375s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:09:54.904851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '06171d9f-41de-436f-980e-759d775d7a7d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:09:54.905590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:54.935088 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: tcp: [76] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]: tcp: [77] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d (non-flash)
May 26 05:09:54.935476 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:09:54.935652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '132'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:09:54.935652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '77')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:54.937809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d', '76')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:09:54.937809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46dbd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:09:54.939515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Removing multipathed devices sdi, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:09:54.939515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Flush multipath device 330000000d0358980 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:09:54.984239 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:54.984457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:54.984669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:54.984774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:54.984940 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:54.985163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6a8326df-9813-4ad2-8121-8ce47cd647aa req-f2be88f0-f26a-46e0-89ed-c8d5b28827da service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:54.992694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:55.046891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:09:55.096217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if SCSI volumes sdi, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:09:55.096415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] SCSI volumes sdi, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:09:55.097337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Checking to see if device paths {'sdi', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:09:55.111539 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Device paths {'sdi', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:09:55.111705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:09:55.122000 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999716350000199 future=<Future at 0x7d7aa420cef0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:55.123321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.123887 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Instance destroyed successfully.
May 26 05:09:55.124174 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lazy-loading 'resources' on Instance uuid debb889d-e74c-4caa-b278-826a5ed536e0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:55.150972 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 77, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.40.100,3260]
May 26 05:09:55.150972 np0000001388 nova-compute[98319]: Logout of [sid: 77, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.40.100,3260] successful.
May 26 05:09:55.150972 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.167233 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.180608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.213152 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 76, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.50.100,3260]
May 26 05:09:55.213152 np0000001388 nova-compute[98319]: Logout of [sid: 76, target: iqn.2023-03.storpool.com:os--volume-06171d9f-41de-436f-980e-759d775d7a7d, portal: 192.168.50.100,3260] successful.
May 26 05:09:55.213152 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.227073 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:09:55.227317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:09:55.227436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] <== disconnect_volume: return (698ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:09:55.227536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:09:55.227800 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Deleting instance files /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c_del
May 26 05:09:55.228275 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Deletion of /opt/stack/data/nova/instances/07d0130e-910b-4ab0-8c20-b2fbde08ac3c_del complete
May 26 05:09:55.411249 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-209725618',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:52Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:09:44Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:09:55.411776 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:55.411776 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:55.412348 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'pci_devices' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:55.626628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:06:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1279744446',display_name='tempest-ServerRescueNegativeTestJSON-server-1279744446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-serverrescuenegativetestjson-server-1279744446',id=40,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:07:20Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b22c1abf2f4ba788005f454c7f8add',ramdisk_id='',reservation_id='r-lxe4ad61',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-161865729',owner_user_name='tempest-ServerRescueNegativeTestJSON-161865729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:07:26Z,user_data=None,user_id='f0799194be46487e89960ac774578992',uuid=debb889d-e74c-4caa-b278-826a5ed536e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:09:55.626830 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converting VIF {"id": "96479187-86e9-4e4d-b112-d286c23de3d7", "address": "fa:16:3e:9d:0f:6c", "network": {"id": "a9a384dd-181e-41b0-8533-28ddc582268a", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-199887175-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "68b22c1abf2f4ba788005f454c7f8add", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap96479187-86", "ovs_interfaceid": "96479187-86e9-4e4d-b112-d286c23de3d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:55.627442 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:55.627684 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:09:55.628531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.628693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96479187-86, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.630622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:55.631954 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.632545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.632667 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f912e5d-5375-49b8-80c4-37a0e49f979b) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.634684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.635634 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:55.637429 np0000001388 nova-compute[98319]: INFO os_vif [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9d:0f:6c,bridge_name='br-int',has_traffic_filtering=True,id=96479187-86e9-4e4d-b112-d286c23de3d7,network=Network(a9a384dd-181e-41b0-8533-28ddc582268a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96479187-86')
May 26 05:09:55.637750 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Deleting instance files /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0_del
May 26 05:09:55.638694 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Deletion of /opt/stack/data/nova/instances/debb889d-e74c-4caa-b278-826a5ed536e0_del complete
May 26 05:09:55.737376 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Took 2.08 seconds to destroy the instance on the hypervisor.
May 26 05:09:55.737904 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:55.738311 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:55.738558 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:55.738850 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:55.799347 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Object Instance<c390c1f4-d1aa-446a-93c7-43417d742588> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] End _get_guest_xml xml=<domain type="qemu">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <uuid>c390c1f4-d1aa-446a-93c7-43417d742588</uuid>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <name>instance-0000002e</name>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestShelveInstance-server-1521278167</nova:name>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:09:51</nova:creationTime>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:user uuid="0e739c6600d84587806f8d18c8c064f1">tempest-TestShelveInstance-917468269-project-member</nova:user>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:project uuid="46d0ca59fdff45d28366bc7eaf9071dc">tempest-TestShelveInstance-917468269</nova:project>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         <nova:port uuid="33ef0430-8f05-4754-8e51-b98e306d943f">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <system>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="serial">c390c1f4-d1aa-446a-93c7-43417d742588</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="uuid">c390c1f4-d1aa-446a-93c7-43417d742588</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </system>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <os>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </os>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <features>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </features>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   <devices>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </disk>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <alias name="ua-2c927b41-d2a6-4c61-bb16-42ff4b045c1c"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <serial>2c927b41-d2a6-4c61-bb16-42ff4b045c1c</serial>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </disk>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:49:b0:40"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <target dev="tap33ef0430-8f"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </interface>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/console.log" append="off"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </serial>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <video>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </video>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </rng>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:   </devices>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: </domain>
May 26 05:09:55.917012 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Preparing to wait for external event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-209725618',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:52Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:09:44Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:09:55.917012 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:09:55.919456 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.919456 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.919456 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:09:55.920913 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.921102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c08b4196-8ab9-5d26-8327-dc87b4ff8141', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.928106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.928983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.929327 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:55.929750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.933207 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.933442 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33ef0430-8f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.933718 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33ef0430-8f, col_values=(('qos', UUID('e98c2572-a1db-4b40-8e38-81707a49f072')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.933906 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33ef0430-8f, col_values=(('external_ids', {'iface-id': '33ef0430-8f05-4754-8e51-b98e306d943f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:b0:40', 'vm-uuid': 'c390c1f4-d1aa-446a-93c7-43417d742588'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:09:55.936287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:09:55.941059 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:55.942700 np0000001388 nova-compute[98319]: INFO os_vif [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f')
May 26 05:09:55.947002 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:55.948911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] Acquiring lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:55.948911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:55.948911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:55.948911 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] No waiting events found dispatching network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:55.948911 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2864cf85-5425-473d-87bc-85a560b08221 req-96887f47-9c9f-48a9-9f1f-43cc31222a07 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-unplugged-20c312b9-39e6-4c91-a234-2318488c511f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:56.145784 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Took 1.34 seconds to destroy the instance on the hypervisor.
May 26 05:09:56.146254 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:09:56.146558 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:09:56.146667 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:09:56.146887 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:56.206515 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:56.531757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-609a4e98-68b0-4dd3-b41a-bc50b21d5753 req-a0784505-90a6-4d85-8519-867f946f7d55 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-deleted-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:56.532114 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-609a4e98-68b0-4dd3-b41a-bc50b21d5753 req-a0784505-90a6-4d85-8519-867f946f7d55 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Neutron deleted interface 96479187-86e9-4e4d-b112-d286c23de3d7; detaching it from the instance and deleting it from the info cache
May 26 05:09:56.532114 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-609a4e98-68b0-4dd3-b41a-bc50b21d5753 req-a0784505-90a6-4d85-8519-867f946f7d55 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:56.535434 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:56.968357 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:09:57.035023 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Took 1.30 seconds to deallocate network for instance.
May 26 05:09:57.037927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-609a4e98-68b0-4dd3-b41a-bc50b21d5753 req-a0784505-90a6-4d85-8519-867f946f7d55 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Detach interface failed, port_id=96479187-86e9-4e4d-b112-d286c23de3d7, reason: Instance debb889d-e74c-4caa-b278-826a5ed536e0 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:09:57.051683 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:57.051893 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] Acquiring lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:57.052171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:57.052171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] Lock "debb889d-e74c-4caa-b278-826a5ed536e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:57.052392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] No waiting events found dispatching network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:09:57.052654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Received event network-vif-unplugged-96479187-86e9-4e4d-b112-d286c23de3d7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:09:57.052908 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ba73368c-ac71-410b-a1e9-f7e8316d6354 req-fc0b8ec5-612a-42a0-9cc2-69b080690215 service nova] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Received event network-vif-deleted-20c312b9-39e6-4c91-a234-2318488c511f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:57.438691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:57.462761 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:57.462945 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:09:57.463028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] No VIF found with MAC fa:16:3e:49:b0:40, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:09:57.463461 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Using config drive
May 26 05:09:57.470126 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Took 1.32 seconds to deallocate network for instance.
May 26 05:09:57.595556 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Took 0.56 seconds to detach 1 volumes for instance.
May 26 05:09:57.965888 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'ec2_ids' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:57.975401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:57.975545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:58.100409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:58.213971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:58.214191 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:58.469103 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Object Instance<c390c1f4-d1aa-446a-93c7-43417d742588> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:09:58.469316 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'keypairs' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:09:58.716614 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:09:58.971957 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Object Instance<c390c1f4-d1aa-446a-93c7-43417d742588> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:09:58.975859 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:09:59.127815 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Creating config drive at /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config
May 26 05:09:59.130747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo11__024 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:09:59.181920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo11__024" returned: 0 in 0.051s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:09:59.202563 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0007541279996985395 future=<Future at 0x7d7ac441bd70 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.203393 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772184.2015822, 21be2726-991c-4d86-971a-d2033d23977b => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:59.203648 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.203947 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] VM Stopped (Lifecycle Event)
May 26 05:09:59.206286 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.4462184280000656 future=<Future at 0x7d7aa44483e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.206436 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.4460074040002837 future=<Future at 0x7d7aa44483e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.223860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.248s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:59.226819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.126s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:59.291139 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Deleted allocations for instance debb889d-e74c-4caa-b278-826a5ed536e0
May 26 05:09:59.500963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:09:59.501149 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:09:59.581452 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.609640 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.612110 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.652830 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003579350000109116 future=<Future at 0x7d7aa44483e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.652962 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.653087 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.323102849999941 future=<Future at 0x7d7ac4445910 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.653209 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.32298123299961 future=<Future at 0x7d7ac4445910 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:09:59.653558 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Emitting event <LifecycleEvent: 1779772184.6523838, 258b4ab0-7d70-4714-b0a8-a1827592acad => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:09:59.653691 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] VM Stopped (Lifecycle Event)
May 26 05:09:59.696661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.708118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 21be2726-991c-4d86-971a-d2033d23977b] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:09:59.758943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fbd5d7aa-96d6-46f1-9b2b-676cbc181f3a req-2a63112c-c7cf-4b87-93cf-8328ad687cf5 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:09:59.760242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbd5d7aa-96d6-46f1-9b2b-676cbc181f3a req-2a63112c-c7cf-4b87-93cf-8328ad687cf5 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:09:59.760242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbd5d7aa-96d6-46f1-9b2b-676cbc181f3a req-2a63112c-c7cf-4b87-93cf-8328ad687cf5 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:09:59.760242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fbd5d7aa-96d6-46f1-9b2b-676cbc181f3a req-2a63112c-c7cf-4b87-93cf-8328ad687cf5 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:09:59.760242 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fbd5d7aa-96d6-46f1-9b2b-676cbc181f3a req-2a63112c-c7cf-4b87-93cf-8328ad687cf5 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Processing event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:09:59.918103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.919321 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.921400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:09:59.939357 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:00.003939 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:00.155903 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: 258b4ab0-7d70-4714-b0a8-a1827592acad] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:00.300037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0996d547-70ab-4467-a987-9c115f7a236a tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Lock "debb889d-e74c-4caa-b278-826a5ed536e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:00.329664 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772200.3293862, c390c1f4-d1aa-446a-93c7-43417d742588 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:00.330018 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Started (Lifecycle Event)
May 26 05:10:00.330309 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:10:00.332488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:10:00.334665 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance spawned successfully.
May 26 05:10:00.335017 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:00.512154 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.285s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:00.557552 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Deleted allocations for instance 07d0130e-910b-4ab0-8c20-b2fbde08ac3c
May 26 05:10:00.832545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:00.834674 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:00.843084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-083256b2-10a1-49e5-b59a-a1aad3411dbf tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.783s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:00.936758 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:01.338083 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772201.3376966, c390c1f4-d1aa-446a-93c7-43417d742588 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:01.338333 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Paused (Lifecycle Event)
May 26 05:10:01.567565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d41e5bc3-8502-4950-92a0-2114ab7a6a4e tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Lock "07d0130e-910b-4ab0-8c20-b2fbde08ac3c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.415s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:01.841359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:01.844471 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772201.844091, c390c1f4-d1aa-446a-93c7-43417d742588 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:01.844673 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Resumed (Lifecycle Event)
May 26 05:10:01.861037 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:01.861552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:01.861959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:01.862632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:01.862821 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:01.863039 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-fb68b4a1-4896-4007-90e3-2cf68fae6ab8 req-611592b7-7d08-4277-907f-2acba28cf140 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received unexpected event network-vif-plugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with vm_state active and task_state None.
May 26 05:10:02.347442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:02.349483 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:02.441412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:02.577014 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:02.872712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:04.995373 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:05.938535 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:07.001415 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:07.096694 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:07.442271 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:08.857264 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:08.976771 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00035740700013775495 future=<Future at 0x7d7ac4445910 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:08.976967 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:08.977444 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772193.975578, 07d0130e-910b-4ab0-8c20-b2fbde08ac3c => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:08.977600 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.1440142010001182 future=<Future at 0x7d7aa420cef0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:08.977856 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] VM Stopped (Lifecycle Event)
May 26 05:10:08.978953 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.1436378379999041 future=<Future at 0x7d7aa420cef0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:09.481087 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-988bae17-56a1-41cd-ab8d-bf45432096ec tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: 07d0130e-910b-4ab0-8c20-b2fbde08ac3c] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:09.919920 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:10.122958 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0013274319999254658 future=<Future at 0x7d7aa420cef0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:10.123075 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:10.125792 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] Emitting event <LifecycleEvent: 1779772195.1215343, debb889d-e74c-4caa-b278-826a5ed536e0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:10.125912 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] VM Stopped (Lifecycle Event)
May 26 05:10:10.629143 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9d50fdb1-bf02-44a2-a584-62a6bb5fd123 tempest-ServerRescueNegativeTestJSON-161865729 tempest-ServerRescueNegativeTestJSON-161865729-project-member] [instance: debb889d-e74c-4caa-b278-826a5ed536e0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:10.941050 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:11.944263 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:12.455572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:13.459128 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:14.056924 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:14.057104 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:14.559317 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:10:15.109420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:15.109420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:15.111441 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:10:15.111582 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Claim successful on node np0000001388
May 26 05:10:15.944072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:16.357943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:16.358108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:16.408981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:16.409213 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:16.859602 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:10:16.911707 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:17.404464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:17.421404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.313s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:17.422053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.017s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:17.422250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:10:17.426688 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:10:17.426836 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Claim successful on node np0000001388
May 26 05:10:17.457190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:17.931884 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:10:17.932122 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:10:17.932459 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:17.932751 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:18.017940 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6abb55160a21467e8a9137d4790b90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efc51fa90bd472aa54bd9d44b862522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:10:18.392121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:18.392121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:18.392369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:18.392435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:18.392603 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:18.394810 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Terminating instance
May 26 05:10:18.428139 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:10:18.448364 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Successfully created port: bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:10:18.686311 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:18.686734 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:18.882227 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Successfully updated port: bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:10:18.897927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:10:18.914246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:18.916355 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:18.931688 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:10:18.937715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-changed-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:18.937715 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Refreshing instance network info cache due to event network-changed-bfdef0e4-27d9-4463-86ac-f670c1ec4b71. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:18.937839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] Acquiring lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:18.937930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] Acquired lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:18.938317 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Refreshing network info cache for port bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:18.939581 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.088942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.095132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.190360 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:19.217091 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999535941999966 future=<Future at 0x7d7aa4280620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:19.217513 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999137627999971 future=<Future at 0x7d7aa4280620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:19.218183 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998927906000063 future=<Future at 0x7d7aa4280620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:19.218942 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Instance destroyed successfully.
May 26 05:10:19.219515 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'resources' on Instance uuid a74c18c3-b0c2-43f4-abed-449a83e9eff0 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:19.384593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:19.440439 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:19.511360 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:19.657856 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:19.699077 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.277s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:19.699511 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:10:19.722936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:09:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1208937757',display_name='tempest-AttachVolumeNegativeTest-server-1208937757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1208937757',id=48,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8a52Km4N7Bwb9yUh/cHOljMsrXU1FHzjbkJ+OpIwPIjECuIpJlvuV3FWc1Z2cx4RWOd+wZWF3vN9ZtJqRtudk6JGQNUFnBPe/jQYqQUIiRsEYfK6989z/CUIm9oiTWkA==',key_name='tempest-keypair-1416872007',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:09:40Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-7yh8ny4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:09:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=a74c18c3-b0c2-43f4-abed-449a83e9eff0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:10:19.723189 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "address": "fa:16:3e:4a:bf:d0", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape8eb467c-d9", "ovs_interfaceid": "e8eb467c-d9ba-479d-8ee0-69d560625bac", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:19.723684 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:19.723925 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:10:19.725124 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.725360 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8eb467c-d9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:19.726327 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.727034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:19.727431 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.727973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.728106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5971b03a-0830-4020-91dd-4b0ce9c37eb8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:19.728805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:19.729334 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:19.731526 np0000001388 nova-compute[98319]: INFO os_vif [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:bf:d0,bridge_name='br-int',has_traffic_filtering=True,id=e8eb467c-d9ba-479d-8ee0-69d560625bac,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8eb467c-d9')
May 26 05:10:19.731821 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Deleting instance files /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0_del
May 26 05:10:19.732523 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Deletion of /opt/stack/data/nova/instances/a74c18c3-b0c2-43f4-abed-449a83e9eff0_del complete
May 26 05:10:19.941382 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:10:19.942381 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:10:19.942672 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Creating image(s)
May 26 05:10:19.943187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:19.943417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:19.944116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:19.944670 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:19.947218 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:19.948246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:20.037241 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:20.037729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:20.038349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:20.039005 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:20.043026 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:20.043758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:20.134632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:20.135191 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:20.161837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6b47250d-5c62-495a-a0b3-ff3b33711ca4 req-cc1c58a8-ab24-4e27-9f11-6f87c10a9ffb service nova] Releasing lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:20.162876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquired lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:20.163297 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:10:20.198549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk 1073741824" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:20.199052 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:20.199547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:20.226694 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:10:20.227051 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:10:20.227846 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:20.228267 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:20.246401 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:10:20.249219 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:10:20.250114 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:10:20.250418 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:10:20.250755 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:20.300793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:20.301344 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:10:20.301633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:20.328360 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad7c375a52924ea48c19cb93653ea10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8032d6bd9bb4c029e534ebae5756f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:10:20.338193 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:20.423733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:20.424384 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Cannot resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:10:20.424802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:10:20.425026 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Ensure instance console log exists: /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:10:20.425776 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:20.426058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:20.426314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:20.726466 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:10:20.749687 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:20.851180 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f9916e3d-8b07-48fe-a28e-cbd9f94e0e99 req-c9136162-9aeb-4b1e-b68a-5e227a60cb78 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-deleted-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:20.851395 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-f9916e3d-8b07-48fe-a28e-cbd9f94e0e99 req-c9136162-9aeb-4b1e-b68a-5e227a60cb78 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Neutron deleted interface e8eb467c-d9ba-479d-8ee0-69d560625bac; detaching it from the instance and deleting it from the info cache
May 26 05:10:20.851592 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f9916e3d-8b07-48fe-a28e-cbd9f94e0e99 req-c9136162-9aeb-4b1e-b68a-5e227a60cb78 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:20.905049 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Successfully created port: c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:10:20.941037 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:21.002890 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:21.003549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:21.003549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:21.003860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:21.003860 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] No waiting events found dispatching network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:21.004038 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:21.004177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:21.004420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Acquiring lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:21.004589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:21.004737 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:21.004889 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] No waiting events found dispatching network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:21.005025 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cf8ac7c6-a61c-428a-b1f9-a6fd385bb242 req-9242c7ab-40cf-40d8-904e-f37433bb0af9 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Received event network-vif-unplugged-e8eb467c-d9ba-479d-8ee0-69d560625bac for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:21.098771 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:21.231926 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:10:21.303675 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:21.357847 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f9916e3d-8b07-48fe-a28e-cbd9f94e0e99 req-c9136162-9aeb-4b1e-b68a-5e227a60cb78 service nova] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Detach interface failed, port_id=e8eb467c-d9ba-479d-8ee0-69d560625bac, reason: Instance a74c18c3-b0c2-43f4-abed-449a83e9eff0 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:10:21.442554 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Successfully updated port: c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:10:21.600774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Releasing lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:21.601143 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance network_info: |[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:10:21.603214 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start _get_guest_xml network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:10:21.605965 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:10:21.607657 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-800092940', uuid='fc92f62b-3d3a-4e8b-a981-8a57840fb928'), owner=OwnerMeta(userid='6abb55160a21467e8a9137d4790b90ad', username='tempest-AttachVolumeTestJSON-1676547055-project-member', projectid='2efc51fa90bd472aa54bd9d44b862522', projectname='tempest-AttachVolumeTestJSON-1676547055'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772221.6071215) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:10:21.608957 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:10:21.609453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:10:21.610235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:10:21.610471 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:10:21.611610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:10:21.611993 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:10:21.612209 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:10:21.612336 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:10:21.612489 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:10:21.612597 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:10:21.612711 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:10:21.612905 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:10:21.613026 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:10:21.613168 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:10:21.613350 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:10:21.613482 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:10:21.630872 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:10:21.631086 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:21.631782 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:21.632505 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'pci_devices' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:21.805778 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Took 1.56 seconds to deallocate network for instance.
May 26 05:10:21.944825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:21.944986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquired lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:21.945109 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:10:22.135108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] End _get_guest_xml xml=<domain type="qemu">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <uuid>fc92f62b-3d3a-4e8b-a981-8a57840fb928</uuid>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <name>instance-00000031</name>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-800092940</nova:name>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:10:21</nova:creationTime>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:user uuid="6abb55160a21467e8a9137d4790b90ad">tempest-AttachVolumeTestJSON-1676547055-project-member</nova:user>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:project uuid="2efc51fa90bd472aa54bd9d44b862522">tempest-AttachVolumeTestJSON-1676547055</nova:project>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         <nova:port uuid="bfdef0e4-27d9-4463-86ac-f670c1ec4b71">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <system>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="serial">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="uuid">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </system>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <os>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </os>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <features>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </features>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   <devices>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ed:b3:54"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <target dev="tapbfdef0e4-27"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </interface>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/console.log" append="off"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </serial>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <video>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </video>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </rng>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:   </devices>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]: </domain>
May 26 05:10:22.135108 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Preparing to wait for external event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:22.136982 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:22.138360 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:10:22.138910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.139279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:22.139581 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:10:22.140274 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.140413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b00f62d6-44a2-5004-b87c-0cb22ff45837', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:22.141213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.141836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:22.142027 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.143778 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.143905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfdef0e4-27, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:22.144236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfdef0e4-27, col_values=(('qos', UUID('a517629a-85a9-4f8b-b18b-32b6ea41a624')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:22.144381 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfdef0e4-27, col_values=(('external_ids', {'iface-id': 'bfdef0e4-27d9-4463-86ac-f670c1ec4b71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b3:54', 'vm-uuid': 'fc92f62b-3d3a-4e8b-a981-8a57840fb928'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:22.145043 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.146017 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:22.151002 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.151853 np0000001388 nova-compute[98319]: INFO os_vif [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:10:22.239660 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:10:22.240544 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:10:22.240747 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Creating image(s)
May 26 05:10:22.241102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:22.241299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:22.241709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:22.242210 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:22.244499 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:22.245323 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:22.312844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:22.313129 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:22.337175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:22.337638 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:22.338103 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:22.338616 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:22.342302 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:22.342692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:22.450829 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:22.451358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:22.467260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:22.513652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk 1073741824" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:22.514621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:22.514621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:22.551482 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:22.623466 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:22.623874 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:10:22.624107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:22.720684 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:22.721110 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:22.724562 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:22.725288 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Cannot resize image /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:10:22.729990 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:10:22.729990 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Ensure instance console log exists: /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:10:22.730381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:22.730590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:22.731212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:22.785602 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:22.906583 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:22.907062 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing instance network info cache due to event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:22.907336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Acquiring lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:22.942213 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:23.225776 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:23.444354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Releasing lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:23.444716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Instance network_info: |[{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:10:23.445029 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Acquired lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:23.446598 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Start _get_guest_xml network_info=[{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:10:23.446926 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:23.449051 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:10:23.450171 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-540168681', uuid='7c3de26e-7807-4a99-943a-474537f0e547'), owner=OwnerMeta(userid='ad7c375a52924ea48c19cb93653ea10e', username='tempest-TestStampPattern-334045049-project-member', projectid='e8032d6bd9bb4c029e534ebae5756f21', projectname='tempest-TestStampPattern-334045049'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772223.4498165) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:10:23.451143 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:10:23.451463 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:10:23.452305 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:10:23.452461 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:10:23.453270 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:10:23.453559 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:10:23.453674 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:10:23.453767 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:10:23.453865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:10:23.453945 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:10:23.454061 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:10:23.454223 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:10:23.454333 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:10:23.454437 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:10:23.454534 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:10:23.454641 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:10:23.465010 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-540168681',display_name='tempest-TestStampPattern-server-540168681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-540168681',id=50,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-2zchjfbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:21Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=7c3de26e-7807-4a99-943a-474537f0e547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:10:23.465366 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:23.465682 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:23.466591 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:23.674895 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:23.675052 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:23.675184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:ed:b3:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:10:23.675670 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Using config drive
May 26 05:10:23.732021 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.419s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:23.780046 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Deleted allocations for instance a74c18c3-b0c2-43f4-abed-449a83e9eff0
May 26 05:10:23.949502 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:23.968955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] End _get_guest_xml xml=<domain type="qemu">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <uuid>7c3de26e-7807-4a99-943a-474537f0e547</uuid>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <name>instance-00000032</name>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestStampPattern-server-540168681</nova:name>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:10:23</nova:creationTime>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:user uuid="ad7c375a52924ea48c19cb93653ea10e">tempest-TestStampPattern-334045049-project-member</nova:user>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:project uuid="e8032d6bd9bb4c029e534ebae5756f21">tempest-TestStampPattern-334045049</nova:project>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         <nova:port uuid="c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <system>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="serial">7c3de26e-7807-4a99-943a-474537f0e547</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="uuid">7c3de26e-7807-4a99-943a-474537f0e547</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </system>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <os>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </os>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <features>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </features>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   <devices>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.config"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:e2:97:44"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <target dev="tapc2ba9bca-ec"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </interface>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/console.log" append="off"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </serial>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <video>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </video>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </rng>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:   </devices>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]: </domain>
May 26 05:10:23.968955 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Preparing to wait for external event network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-540168681',display_name='tempest-TestStampPattern-server-540168681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-540168681',id=50,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-2zchjfbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:21Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=7c3de26e-7807-4a99-943a-474537f0e547,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:10:23.972679 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.973324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:23.973973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:10:23.974529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.974529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1039082e-b9c5-5141-b0d2-23e09ecfc787', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:23.985746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.986558 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:23.992755 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.995048 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.995190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ba9bca-ec, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:23.995606 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ba9bca-ec, col_values=(('qos', UUID('a849f8bd-bf39-486a-89fb-95305515cc79')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:23.995803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ba9bca-ec, col_values=(('external_ids', {'iface-id': 'c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:97:44', 'vm-uuid': '7c3de26e-7807-4a99-943a-474537f0e547'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:23.996660 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:23.998996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:24.008847 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:24.009968 np0000001388 nova-compute[98319]: INFO os_vif [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec')
May 26 05:10:24.181662 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:24.247763 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:24.334317 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Creating config drive at /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config
May 26 05:10:24.338108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1uicxc7h {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:24.402726 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updated VIF entry in instance network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:24.403369 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:24.405503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1uicxc7h" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:24.789465 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-58a70834-039b-4f11-9532-75ce2fc66616 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "a74c18c3-b0c2-43f4-abed-449a83e9eff0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.397s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:24.801555 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:24.829501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:24.829645 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:24.906300 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Releasing lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:24.906496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:24.906684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:24.906864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:24.906958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:24.907077 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No event matching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 in dict_keys([('network-vif-plugged', 'bfdef0e4-27d9-4463-86ac-f670c1ec4b71')]) {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}}
May 26 05:10:24.907237 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0d4f77a8-61fd-4aaa-8396-1a7751bfd80d req-26e3c8f1-a90c-4860-9649-54ed2db29c8a service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state building and task_state spawning.
May 26 05:10:24.918490 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:24.985385 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95b10d1b-d6f9-4005-82f6-899c364ec265 req-8f934801-e53a-4255-af75-d5c9b7104b83 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:24.985385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95b10d1b-d6f9-4005-82f6-899c364ec265 req-8f934801-e53a-4255-af75-d5c9b7104b83 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:24.985385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95b10d1b-d6f9-4005-82f6-899c364ec265 req-8f934801-e53a-4255-af75-d5c9b7104b83 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:24.985863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95b10d1b-d6f9-4005-82f6-899c364ec265 req-8f934801-e53a-4255-af75-d5c9b7104b83 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:24.985863 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95b10d1b-d6f9-4005-82f6-899c364ec265 req-8f934801-e53a-4255-af75-d5c9b7104b83 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Processing event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:10:25.165630 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:25.178289 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:25.202221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:25.530160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:25.530318 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:25.530421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No VIF found with MAC fa:16:3e:e2:97:44, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:10:25.530869 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Using config drive
May 26 05:10:25.696145 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772225.695693, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:25.696728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:10:25.696967 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Started (Lifecycle Event)
May 26 05:10:25.698963 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:10:25.701423 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance spawned successfully.
May 26 05:10:25.701682 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:10:26.037073 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:26.118124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:26.118307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:26.170930 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Creating config drive at /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.config
May 26 05:10:26.175886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvd9xjjme {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:26.202268 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:26.211631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:26.215425 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.215594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.215942 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.216232 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.216520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.216794 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:26.228759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpvd9xjjme" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:26.620934 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Detaching volume f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f
May 26 05:10:26.666771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:26.672648 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Attempting to driver detach volume f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f from mountpoint /dev/vdb
May 26 05:10:26.679016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:10:26.680329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:10:26.680443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Attempting to detach device vdb from instance 013b0bd1-140e-45dc-a5fa-73f702d59332 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:10:26.680687 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <alias name="ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f"/>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <serial>f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f</serial>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]: </disk>
May 26 05:10:26.680687 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:10:26.688018 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:26.691062 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 013b0bd1-140e-45dc-a5fa-73f702d59332 from the persistent domain config.
May 26 05:10:26.691062 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] (1/8): Attempting to detach device vdb with device alias ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f from instance 013b0bd1-140e-45dc-a5fa-73f702d59332 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:10:26.691390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <alias name="ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f"/>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <serial>f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f</serial>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]: </disk>
May 26 05:10:26.691390 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:10:26.691867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:26.714999 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:10:26.715432 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772226.715117, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:26.715721 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Paused (Lifecycle Event)
May 26 05:10:26.722341 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Took 6.78 seconds to spawn the instance on the hypervisor.
May 26 05:10:26.722731 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:26.801467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:26.885446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76b28870-8cda-4384-a5cc-becc41111b0a req-4d1871ff-14f9-4176-bbe3-4c769171cc82 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:26.885738 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76b28870-8cda-4384-a5cc-becc41111b0a req-4d1871ff-14f9-4176-bbe3-4c769171cc82 service nova] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:26.885997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76b28870-8cda-4384-a5cc-becc41111b0a req-4d1871ff-14f9-4176-bbe3-4c769171cc82 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:26.886297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-76b28870-8cda-4384-a5cc-becc41111b0a req-4d1871ff-14f9-4176-bbe3-4c769171cc82 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:26.886489 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-76b28870-8cda-4384-a5cc-becc41111b0a req-4d1871ff-14f9-4176-bbe3-4c769171cc82 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Processing event network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:10:27.073452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:27.074235 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:27.074366 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:27.074507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:27.074643 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:27.074755 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-81240a23-a81c-4fb3-b613-199d136e8608 req-1df1610f-9ffd-4255-ac0b-a3664ab4d406 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state active and task_state None.
May 26 05:10:27.087039 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.090368 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.094648 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.118361 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.118361 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.226224 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:27.226224 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772227.2259831, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:27.226415 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Resumed (Lifecycle Event)
May 26 05:10:27.234874 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Took 12.17 seconds to build instance.
May 26 05:10:27.288302 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f for instance 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:10:27.466220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:27.477434 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:10:27.479797 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:10:27.483991 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Instance spawned successfully.
May 26 05:10:27.484309 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:10:27.617631 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:27.617909 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:27.618135 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:27.618691 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:27.729127 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:27.734659 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:27.736450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.679s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:27.992219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:27.992219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:27.992219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:27.992219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:27.992467 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:27.992694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:28.237862 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772228.2374358, 013b0bd1-140e-45dc-a5fa-73f702d59332 => ua-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:10:28.238395 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772228.2377872, 7c3de26e-7807-4a99-943a-474537f0e547 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:28.238395 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] VM Started (Lifecycle Event)
May 26 05:10:28.243215 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 013b0bd1-140e-45dc-a5fa-73f702d59332 from the live domain config.
May 26 05:10:28.244774 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:10:28.245222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:10:28.245321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:10:28.247231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:10:28.247231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:10:28.247231 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:10:28.278427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:10:28.278427 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:10:28.278427 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:28.278427 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:28.278427 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:10:28.278664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [125] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:10:28.278664 np0000001388 nova-compute[98319]: tcp: [126] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f (non-flash)
May 26 05:10:28.278664 np0000001388 nova-compute[98319]: tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:28.278664 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:28.278664 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:10:28.278664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '132')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:10:28.278904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '125')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:10:28.279949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f', '126')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:10:28.280657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4442d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:10:28.280835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Removing multipathed devices sde, sdg {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:10:28.281026 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flush multipath device 330000000aa039139 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:10:28.315698 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:10:28.360002 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:10:28.402382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if SCSI volumes sde, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:10:28.402640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] SCSI volumes sde, sdg have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:10:28.403967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if device paths {'sde', 'sdg'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:10:28.415186 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Device paths {'sde', 'sdg'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:10:28.415500 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:10:28.429743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.461807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.40.100,3260]
May 26 05:10:28.461807 np0000001388 nova-compute[98319]: Logout of [sid: 125, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.40.100,3260] successful.
May 26 05:10:28.461807 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.476047 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.488607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.497123 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Took 6.26 seconds to spawn the instance on the hypervisor.
May 26 05:10:28.497324 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:28.503481 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:28.503481 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:28.516922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.50.100,3260]
May 26 05:10:28.516922 np0000001388 nova-compute[98319]: Logout of [sid: 126, target: iqn.2023-03.storpool.com:os--volume-f2565ce2-cb0d-4f67-87c3-f307fe9c3a0f, portal: 192.168.50.100,3260] successful.
May 26 05:10:28.516922 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.540237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:28.540536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:10:28.540703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== disconnect_volume: return (295ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:10:28.540850 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:10:28.596418 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-changed-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:28.598361 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Refreshing instance network info cache due to event network-changed-bfdef0e4-27d9-4463-86ac-f670c1ec4b71. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:28.598361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] Acquiring lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:28.598361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] Acquired lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:28.598361 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Refreshing network info cache for port bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:28.617619 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:28.617939 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:28.741132 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:28.743286 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:28.948621 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:28.948821 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:28.949012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:28.949159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:28.949318 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] No waiting events found dispatching network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:28.949445 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-28181563-d19c-4654-b3b2-b63733959ae2 req-a2616b95-5a26-4855-97e6-781d41560089 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received unexpected event network-vif-plugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 for instance with vm_state active and task_state None.
May 26 05:10:29.007810 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Took 11.64 seconds to build instance.
May 26 05:10:29.011138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:29.089905 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:29.101778 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:29.246632 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772229.246289, 7c3de26e-7807-4a99-943a-474537f0e547 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:29.247016 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] VM Paused (Lifecycle Event)
May 26 05:10:29.401176 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:29.509633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:29.544948 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updated VIF entry in instance network info cache for port bfdef0e4-27d9-4463-86ac-f670c1ec4b71. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:29.545449 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:29.749223 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:29.751382 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772229.7510946, 7c3de26e-7807-4a99-943a-474537f0e547 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:29.751563 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] VM Resumed (Lifecycle Event)
May 26 05:10:30.047548 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bd9834f-8371-4a15-8a15-1a44aec08949 req-9592488a-f387-4942-9437-1916b8852d54 service nova] Releasing lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:30.097764 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d4792d3c-e04a-4967-900c-befa54bc3295 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.979s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:30.258937 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:30.265114 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:30.464724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:30.465411 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:30.465718 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:30.465953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:30.466237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:30.471173 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Terminating instance
May 26 05:10:30.618258 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:30.618387 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 26 05:10:30.655661 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:30.655848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing instance network info cache due to event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:30.655920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] Acquiring lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:30.655976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] Acquired lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:30.656091 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:30.975469 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:10:30.993103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.017492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.038042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.043259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.120245 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:31.158005 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:31.164882 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:31.165190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:31.165422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:31.165586 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:31.165702 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] No waiting events found dispatching network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:31.165818 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-63bef2f1-caa4-4bd4-b1e3-e7f9e57d5077 req-134cd0f2-8979-4d5f-a3b4-3bd5d5293677 service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:31.307664 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.314105 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.334089 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999755942999855 future=<Future at 0x7d7aa4159670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:31.336711 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Instance destroyed successfully.
May 26 05:10:31.337109 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'resources' on Instance uuid 013b0bd1-140e-45dc-a5fa-73f702d59332 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:31.524434 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:31.662305 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updated VIF entry in instance network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:31.662552 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:31.839920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-964296347',display_name='tempest-AttachVolumeNegativeTest-server-964296347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-964296347',id=44,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnfMYJTGm0M8SPhQ9GlggTcEf1zfygRibRGcAOVrZwNN5JvdPGv/LYqgm2WmrCVqZ3url7+6ePe97PDy218y0hNMcKwBMG/Kj7fkI2LLmOaE5oTmN+cWgReaLwC8+HPJg==',key_name='tempest-keypair-901492531',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:08:33Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-eddkms83',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=013b0bd1-140e-45dc-a5fa-73f702d59332,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:10:31.840130 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "address": "fa:16:3e:39:fd:ac", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap371911ea-95", "ovs_interfaceid": "371911ea-95e3-4421-a4b5-e7e477cf0ef3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:31.840969 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:31.841209 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:10:31.842690 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.843037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap371911ea-95, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:31.844101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.845001 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:31.845187 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.846300 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.846521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e21a9e-ee19-47a0-b799-68151e0915a0) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:31.847000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:31.848069 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:31.849951 np0000001388 nova-compute[98319]: INFO os_vif [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:fd:ac,bridge_name='br-int',has_traffic_filtering=True,id=371911ea-95e3-4421-a4b5-e7e477cf0ef3,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap371911ea-95')
May 26 05:10:31.850304 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Deleting instance files /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332_del
May 26 05:10:31.851147 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Deletion of /opt/stack/data/nova/instances/013b0bd1-140e-45dc-a5fa-73f702d59332_del complete
May 26 05:10:32.121322 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:32.121322 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:32.121322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:10:32.121322 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:32.165307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-120062e2-7659-4d05-b65f-9d6330daaf3a req-96a4daef-a80e-4b81-a489-527746862018 service nova] Releasing lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:32.357720 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Took 1.38 seconds to destroy the instance on the hypervisor.
May 26 05:10:32.358369 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:10:32.358727 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:10:32.358852 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:10:32.359146 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:32.428856 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:32.467808 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:32.627596 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:32.627774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:32.627899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:32.628026 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:10:33.231083 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:33.231665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] Acquiring lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:33.232212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:33.232416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:33.232607 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] No waiting events found dispatching network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:33.232772 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d720657d-38e2-4853-8cae-ca9d1b6b5295 req-a0f2239e-a3de-4f78-b431-63f6bfa1e44b service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-unplugged-371911ea-95e3-4421-a4b5-e7e477cf0ef3 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:33.423674 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e568b029-054e-45a8-8d44-2b8a5604f550 req-fdaa56e3-f3fa-4d0e-b66d-fbca5d84406c service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Received event network-vif-deleted-371911ea-95e3-4421-a4b5-e7e477cf0ef3 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:33.424057 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-e568b029-054e-45a8-8d44-2b8a5604f550 req-fdaa56e3-f3fa-4d0e-b66d-fbca5d84406c service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Neutron deleted interface 371911ea-95e3-4421-a4b5-e7e477cf0ef3; detaching it from the instance and deleting it from the info cache
May 26 05:10:33.424057 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e568b029-054e-45a8-8d44-2b8a5604f550 req-fdaa56e3-f3fa-4d0e-b66d-fbca5d84406c service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:33.654450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:33.751916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:33.752570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:33.857091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:33.861819 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:10:33.864750 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:33.881221 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:33.929114 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e568b029-054e-45a8-8d44-2b8a5604f550 req-fdaa56e3-f3fa-4d0e-b66d-fbca5d84406c service nova] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Detach interface failed, port_id=371911ea-95e3-4421-a4b5-e7e477cf0ef3, reason: Instance 013b0bd1-140e-45dc-a5fa-73f702d59332 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:10:33.956405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:33.957012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:34.049062 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:34.052537 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:10:34.053736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:34.097985 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:34.098395 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13544MB free_disk=72.93449401855469GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:10:34.098532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:34.098747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:34.217311 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005916640002396889 future=<Future at 0x7d7aa4280620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:34.217508 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:34.217692 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.116133394999906 future=<Future at 0x7d7aa4159670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:34.218180 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Emitting event <LifecycleEvent: 1779772219.2165427, a74c18c3-b0c2-43f4-abed-449a83e9eff0 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:34.218410 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.115413217999958 future=<Future at 0x7d7aa4159670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:34.218586 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] VM Stopped (Lifecycle Event)
May 26 05:10:34.385663 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Took 2.03 seconds to deallocate network for instance.
May 26 05:10:34.721095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-85b15225-237c-4c02-8353-3d4a5a1fac27 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: a74c18c3-b0c2-43f4-abed-449a83e9eff0] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:34.893491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:35.168177 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 013b0bd1-140e-45dc-a5fa-73f702d59332 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:10:35.168470 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c390c1f4-d1aa-446a-93c7-43417d742588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:10:35.168619 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:10:35.168764 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7c3de26e-7807-4a99-943a-474537f0e547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:10:35.168976 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:10:35.169154 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:10:34 up 42 min,  2 users,  load average: 5.37, 6.47, 4.73\n', 'num_instances': '4', 'num_vm_active': '4', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_2efc51fa90bd472aa54bd9d44b862522': '1', 'io_workload': '0', 'num_proj_e8032d6bd9bb4c029e534ebae5756f21': '1', 'num_task_deleting': '1', 'num_proj_23047976f3814538912524932a6a9375': '1', 'num_proj_46d0ca59fdff45d28366bc7eaf9071dc': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:10:35.398431 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:35.398633 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:35.901084 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:36.588983 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:10:36.589153 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.490s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:36.589758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.696s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:36.590021 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.03 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:36.828477 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:36.828714 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:36.848105 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:37.333139 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:37.469877 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:37.558856 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:37.558856 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing instance network info cache due to event network-changed-33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:37.558856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] Acquiring lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:37.558856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] Acquired lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:37.559014 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Refreshing network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:37.838524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.249s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:37.913832 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Deleted allocations for instance 013b0bd1-140e-45dc-a5fa-73f702d59332
May 26 05:10:38.062174 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:38.096216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:38.097134 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:38.097463 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:38.097626 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:38.097753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:38.100593 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Terminating instance
May 26 05:10:38.373523 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:38.579736 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updated VIF entry in instance network info cache for port 33ef0430-8f05-4754-8e51-b98e306d943f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:38.580027 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [{"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:38.604665 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:10:38.618035 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:38.618232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 26 05:10:38.630319 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:38.649392 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:38.650734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:38.677796 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:38.796462 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:38.797670 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:38.797965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:38.798188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:38.798428 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:38.799064 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ea10c0a-f328-4f21-9e70-0d2b890a0db2 req-f5fad1f4-f671-40b9-9ebc-04d9f471b99d service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:38.923745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8815e55a-527b-4e73-8269-7508193031d3 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "013b0bd1-140e-45dc-a5fa-73f702d59332" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.458s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:38.946325 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999671896000109 future=<Future at 0x7d7af51e6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:38.948786 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Instance destroyed successfully.
May 26 05:10:38.949129 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lazy-loading 'resources' on Instance uuid c390c1f4-d1aa-446a-93c7-43417d742588 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:39.081948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b08a75f-66dd-463f-8d83-2833c1ddf53b req-abef27da-4636-4132-90e2-0bf014de6d24 service nova] Releasing lock "refresh_cache-c390c1f4-d1aa-446a-93c7-43417d742588" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:39.120670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 26 05:10:39.120952 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:39.451835 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-05-26T05:08:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1521278167',display_name='tempest-TestShelveInstance-server-1521278167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testshelveinstance-server-1521278167',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrckk/r+WkT3AexHRfVCeISlqf2otyD3FzNcz6REARM00TA/PMkVHdRUj+2YqtchX2kG0Oag/lSUhJKOIIV+GNU5kVNqLRneKasaCRLw3CAHtT6Sfd4/IM8jSkU8L2cAQ==',key_name='tempest-TestShelveInstance-209725618',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:00Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46d0ca59fdff45d28366bc7eaf9071dc',ramdisk_id='',reservation_id='r-62jb2nub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-917468269',owner_user_name='tempest-TestShelveInstance-917468269-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:10:00Z,user_data=None,user_id='0e739c6600d84587806f8d18c8c064f1',uuid=c390c1f4-d1aa-446a-93c7-43417d742588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:10:39.452378 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converting VIF {"id": "33ef0430-8f05-4754-8e51-b98e306d943f", "address": "fa:16:3e:49:b0:40", "network": {"id": "721fc5ab-8fe6-4756-b863-8943867948a1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1611625144-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "46d0ca59fdff45d28366bc7eaf9071dc", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33ef0430-8f", "ovs_interfaceid": "33ef0430-8f05-4754-8e51-b98e306d943f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:39.453159 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:39.453895 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:10:39.455137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:39.455395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33ef0430-8f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:39.458720 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:39.459001 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:39.460021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:39.460374 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e98c2572-a1db-4b40-8e38-81707a49f072) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:39.461093 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:39.463223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:39.465945 np0000001388 nova-compute[98319]: INFO os_vif [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:b0:40,bridge_name='br-int',has_traffic_filtering=True,id=33ef0430-8f05-4754-8e51-b98e306d943f,network=Network(721fc5ab-8fe6-4756-b863-8943867948a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33ef0430-8f')
May 26 05:10:39.468885 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:10:39.469420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:10:39.470252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:10:39.470356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:10:39.470938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:10:39.471212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:10:39.502969 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:39.502969 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:39.502969 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:10:39.503092 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsi session list stdout=tcp: [131] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:39.503092 np0000001388 nova-compute[98319]: tcp: [132] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c (non-flash)
May 26 05:10:39.503092 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:10:39.503184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '131'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '132')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:10:39.503307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '131')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:10:39.504188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c', '132')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:10:39.504789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f20c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:10:39.504991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:10:39.505253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Flush multipath device 3300000004cda2c44 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:10:39.560919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:10:39.604136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:10:39.648709 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:10:39.648851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:10:39.649641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:10:39.661472 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:10:39.661651 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:10:39.673524 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.698772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 131, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260]
May 26 05:10:39.698772 np0000001388 nova-compute[98319]: Logout of [sid: 131, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.40.100,3260] successful.
May 26 05:10:39.698772 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.712718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.725835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.757509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 132, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260]
May 26 05:10:39.757509 np0000001388 nova-compute[98319]: Logout of [sid: 132, target: iqn.2023-03.storpool.com:os--volume-2c927b41-d2a6-4c61-bb16-42ff4b045c1c, portal: 192.168.50.100,3260] successful.
May 26 05:10:39.757509 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.768111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:10:39.768381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:10:39.768586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] <== disconnect_volume: return (298ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:10:39.768633 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:10:39.769182 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deleting instance files /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588_del
May 26 05:10:39.769654 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deletion of /opt/stack/data/nova/instances/c390c1f4-d1aa-446a-93c7-43417d742588_del complete
May 26 05:10:40.277314 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Took 1.67 seconds to destroy the instance on the hypervisor.
May 26 05:10:40.279098 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:10:40.280641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:10:40.280641 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:10:40.280641 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:40.411270 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:40.871139 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:40.871588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] Acquiring lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:40.871588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:40.871588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] Lock "c390c1f4-d1aa-446a-93c7-43417d742588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:40.871731 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] No waiting events found dispatching network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:40.871842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-unplugged-33ef0430-8f05-4754-8e51-b98e306d943f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:10:40.872006 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Received event network-vif-deleted-33ef0430-8f05-4754-8e51-b98e306d943f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:40.872057 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Neutron deleted interface 33ef0430-8f05-4754-8e51-b98e306d943f; detaching it from the instance and deleting it from the info cache
May 26 05:10:40.872151 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:41.181917 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:41.376978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c6d05fe5-31fa-4c96-9ffa-3e7f281d6754 req-acb0693d-b94b-4aca-a777-0f335587c014 service nova] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Detach interface failed, port_id=33ef0430-8f05-4754-8e51-b98e306d943f, reason: Instance c390c1f4-d1aa-446a-93c7-43417d742588 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:10:41.685630 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Took 1.41 seconds to deallocate network for instance.
May 26 05:10:42.241138 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Took 0.56 seconds to detach 1 volumes for instance.
May 26 05:10:42.242767 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Deleting volume: 2c927b41-d2a6-4c61-bb16-42ff4b045c1c {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:10:42.445397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:42.445678 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:42.471293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:42.617824 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:10:42.785727 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:42.785900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:42.947920 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:10:43.122210 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:10:43.209077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:43.209411 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:43.515406 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:43.712192 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:44.219222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.433s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:44.220882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.705s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:44.224531 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:10:44.224669 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Claim successful on node np0000001388
May 26 05:10:44.270250 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Deleted allocations for instance c390c1f4-d1aa-446a-93c7-43417d742588
May 26 05:10:44.461670 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:45.280905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0b2cb423-cc1a-4e76-9348-60c0ef4cdfe7 tempest-TestShelveInstance-917468269 tempest-TestShelveInstance-917468269-project-member] Lock "c390c1f4-d1aa-446a-93c7-43417d742588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:45.299561 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Refreshing inventories for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 26 05:10:45.357193 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Updating ProviderTree inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 26 05:10:45.357403 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 05:10:45.410464 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Refreshing aggregate associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 26 05:10:45.475649 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Refreshing trait associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, traits: COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 26 05:10:45.699297 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:45.699567 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:46.202551 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:46.334580 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0007229490001918748 future=<Future at 0x7d7aa4159670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:46.335012 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:46.335012 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.611179965000247 future=<Future at 0x7d7af51e6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:46.335012 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.611086479000278 future=<Future at 0x7d7af51e6ff0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:46.335941 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Emitting event <LifecycleEvent: 1779772231.3337352, 013b0bd1-140e-45dc-a5fa-73f702d59332 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:46.336275 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] VM Stopped (Lifecycle Event)
May 26 05:10:46.713540 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.494s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:46.714065 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:10:46.838865 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-aac2dd76-68b2-4255-93a2-b6264d58bf73 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 013b0bd1-140e-45dc-a5fa-73f702d59332] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:47.220285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:10:47.220468 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:10:47.220731 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:47.220949 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:47.288495 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5137ef274a4a94a48962027c45d899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23047976f3814538912524932a6a9375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:10:47.418997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:47.472781 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:47.723485 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:10:47.732094 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Successfully created port: 33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:10:48.200935 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Successfully updated port: 33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:10:48.225978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:10:48.245925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-changed-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:48.246036 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Refreshing instance network info cache due to event network-changed-33e6d629-7538-443f-bcee-d68cfb20c902. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:48.246181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] Acquiring lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:48.246316 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] Acquired lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:48.246471 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Refreshing network info cache for port 33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:48.705745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:48.748702 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:48.812158 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:48.939925 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:49.227649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:49.235571 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:10:49.236453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:10:49.236642 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Creating image(s)
May 26 05:10:49.236992 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:49.237131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:49.237580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:49.237954 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:49.240355 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:49.241074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:49.331208 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:49.332117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:49.332117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:49.332553 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:49.334886 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:49.335154 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:49.423366 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:49.423839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:49.443418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83a514d3-409c-44b1-94d7-9c871fff6e57 req-b21dbbfe-f1c8-458a-aa8e-1b1c84c63354 service nova] Releasing lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:49.444550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquired lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:49.444900 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:10:49.462214 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:49.486446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk 1073741824" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:49.486843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:49.487138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:49.590866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:49.591407 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:10:49.591637 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:49.685097 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:49.685575 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Cannot resize image /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:10:49.686026 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:10:49.686247 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Ensure instance console log exists: /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:10:49.686599 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:49.686806 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:49.686947 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:49.799040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:49.799454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:50.006882 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:50.186004 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:50.301090 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:10:50.347317 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Updating instance_info_cache with network_info: [{"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:50.849322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Releasing lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:50.849670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance network_info: |[{"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:10:50.851265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Start _get_guest_xml network_info=[{"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:10:50.855550 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:10:50.857242 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-1035257622', uuid='18b8f158-289d-4829-b892-766548f70009'), owner=OwnerMeta(userid='3a5137ef274a4a94a48962027c45d899', username='tempest-AttachVolumeNegativeTest-1739279332-project-member', projectid='23047976f3814538912524932a6a9375', projectname='tempest-AttachVolumeNegativeTest-1739279332'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772250.8567493) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:10:50.860257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:50.860599 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:10:50.860720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:50.861093 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:10:50.863529 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:10:50.863701 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Claim successful on node np0000001388
May 26 05:10:50.866002 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:10:50.866309 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:10:50.867458 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:10:50.867848 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:10:50.868052 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:10:50.868181 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:10:50.868389 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:10:50.868514 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:10:50.868656 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:10:50.868882 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:10:50.869023 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:10:50.869183 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:10:50.869625 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:10:50.869840 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:10:50.890128 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035257622',display_name='tempest-AttachVolumeNegativeTest-server-1035257622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1035257622',id=51,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlQ7FKVPbUX7tILN00y99rOOTio2sn5q9jOoPGVrK4jCHmPhIBEKGiVvCxnsDhSqGC22+0yXWeG3yqsRLfaZH/nj4/hdWrAKLq2BAFT0sVyNfRHlGJUWqIh8IKt4aP8bg==',key_name='tempest-keypair-1320245493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-rdfg616a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=18b8f158-289d-4829-b892-766548f70009,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:10:50.890398 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:50.891157 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:50.891968 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'pci_devices' on Instance uuid 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:51.396162 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] End _get_guest_xml xml=<domain type="qemu">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <uuid>18b8f158-289d-4829-b892-766548f70009</uuid>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <name>instance-00000033</name>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1035257622</nova:name>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:10:50</nova:creationTime>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:user uuid="3a5137ef274a4a94a48962027c45d899">tempest-AttachVolumeNegativeTest-1739279332-project-member</nova:user>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:project uuid="23047976f3814538912524932a6a9375">tempest-AttachVolumeNegativeTest-1739279332</nova:project>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         <nova:port uuid="33e6d629-7538-443f-bcee-d68cfb20c902">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <system>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="serial">18b8f158-289d-4829-b892-766548f70009</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="uuid">18b8f158-289d-4829-b892-766548f70009</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </system>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <os>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </os>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <features>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </features>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   <devices>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.config"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:eb:57:04"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <target dev="tap33e6d629-75"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </interface>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/console.log" append="off"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </serial>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <video>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </video>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </rng>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:   </devices>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]: </domain>
May 26 05:10:51.396162 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Preparing to wait for external event network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035257622',display_name='tempest-AttachVolumeNegativeTest-server-1035257622',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1035257622',id=51,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlQ7FKVPbUX7tILN00y99rOOTio2sn5q9jOoPGVrK4jCHmPhIBEKGiVvCxnsDhSqGC22+0yXWeG3yqsRLfaZH/nj4/hdWrAKLq2BAFT0sVyNfRHlGJUWqIh8IKt4aP8bg==',key_name='tempest-keypair-1320245493',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-rdfg616a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=18b8f158-289d-4829-b892-766548f70009,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:51.398323 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:51.398783 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:10:51.398973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.399142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:51.399476 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:10:51.400172 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.400409 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e428eea-c83c-596b-97e4-60937366fcb9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:51.402112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.402893 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:51.404646 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.404805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33e6d629-75, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:51.405135 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap33e6d629-75, col_values=(('qos', UUID('92672bad-36f9-4f54-a015-f4909e041380')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:51.405363 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap33e6d629-75, col_values=(('external_ids', {'iface-id': '33e6d629-7538-443f-bcee-d68cfb20c902', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:57:04', 'vm-uuid': '18b8f158-289d-4829-b892-766548f70009'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:51.407639 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.408765 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:51.413134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:51.414123 np0000001388 nova-compute[98319]: INFO os_vif [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75')
May 26 05:10:52.111775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:10:52.111775 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:10:52.478775 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:52.614675 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:10:52.936225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:52.936225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:52.936225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:eb:57:04, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:10:52.936225 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Using config drive
May 26 05:10:53.007492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:53.122074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.261s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:53.122705 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:10:53.320788 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:53.442377 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:53.620999 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Creating config drive at /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.config
May 26 05:10:53.625785 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxwne1ynh {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:53.652525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:10:53.655033 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:10:53.656938 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:53.657932 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:53.698111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxwne1ynh" returned: 0 in 0.072s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:53.846659 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43c0d7e3912b49158e917063a7b83487', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c128de45147e4a778e1edeb549bc59f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:10:53.947010 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000900012999863975 future=<Future at 0x7d7af51e6ff0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:53.947497 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772238.9458947, c390c1f4-d1aa-446a-93c7-43417d742588 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:53.947627 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:10:53.947860 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] VM Stopped (Lifecycle Event)
May 26 05:10:54.158164 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:10:54.206225 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.219306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.222803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.325088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.416693 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7381ec88-cc1f-45b6-a148-8f395d54f692 req-3671cbb2-a109-4320-a34c-131c20b597c0 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:54.416930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7381ec88-cc1f-45b6-a148-8f395d54f692 req-3671cbb2-a109-4320-a34c-131c20b597c0 service nova] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:54.417280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7381ec88-cc1f-45b6-a148-8f395d54f692 req-3671cbb2-a109-4320-a34c-131c20b597c0 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:54.417489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7381ec88-cc1f-45b6-a148-8f395d54f692 req-3671cbb2-a109-4320-a34c-131c20b597c0 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:54.419728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7381ec88-cc1f-45b6-a148-8f395d54f692 req-3671cbb2-a109-4320-a34c-131c20b597c0 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Processing event network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:10:54.450539 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: c390c1f4-d1aa-446a-93c7-43417d742588] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:54.610023 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.612717 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.614697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.637545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:54.665063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:10:54.796589 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Successfully created port: 234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:10:55.175222 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772255.1721575, 18b8f158-289d-4829-b892-766548f70009 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:55.175222 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] VM Started (Lifecycle Event)
May 26 05:10:55.175222 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:10:55.176732 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:10:55.181131 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance spawned successfully.
May 26 05:10:55.182575 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:10:55.519965 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:55.520437 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:55.520437 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:55.520549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:55.520685 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] No waiting events found dispatching network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:55.520761 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f601483e-612f-4ad8-ad93-80616ae4cd87 req-c46881b6-c03e-47a3-b384-684a4652f570 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received unexpected event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 for instance with vm_state building and task_state spawning.
May 26 05:10:55.623735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Creating image(s)
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:55.719662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:55.731160 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.731380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.735260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.735640 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.736033 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.736392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:10:55.812023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:55.814471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:55.815674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:55.816239 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:55.821527 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:10:55.824125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:55.872881 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Successfully updated port: 234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:10:55.938658 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:55.939079 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:56.008591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk 1073741824" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:56.009275 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.194s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:56.009521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:56.112100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:56.112629 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:10:56.112881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:10:56.193493 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:10:56.194776 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772256.194372, 18b8f158-289d-4829-b892-766548f70009 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:56.195023 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] VM Paused (Lifecycle Event)
May 26 05:10:56.236114 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:10:56.236589 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Cannot resize image /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:10:56.236912 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:10:56.237065 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Ensure instance console log exists: /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:10:56.237430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:56.237653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:56.237808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:56.247987 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Took 7.01 seconds to spawn the instance on the hypervisor.
May 26 05:10:56.248168 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:56.376782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:56.376967 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquired lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:56.377122 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:10:56.406949 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] No waiting events found dispatching network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received unexpected event network-vif-plugged-33e6d629-7538-443f-bcee-d68cfb20c902 for instance with vm_state active and task_state None.
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-changed-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Refreshing instance network info cache due to event network-changed-234b5dca-9ec2-4718-aec3-c40df72b1688. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:56.498388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Acquiring lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:56.700980 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:56.703963 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772256.7036502, 18b8f158-289d-4829-b892-766548f70009 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:10:56.704127 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] VM Resumed (Lifecycle Event)
May 26 05:10:56.760847 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Took 13.31 seconds to build instance.
May 26 05:10:56.954647 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:10:57.152034 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:57.208587 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:10:57.211716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 18b8f158-289d-4829-b892-766548f70009] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:10:57.263234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-78aec0d6-18fd-47db-8f8d-685c5a356f08 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.817s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:57.299161 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Updating instance_info_cache with network_info: [{"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:57.486379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:57.804379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Releasing lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:57.804379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Instance network_info: |[{"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:10:57.804379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Acquired lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:57.804379 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Refreshing network info cache for port 234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:57.805028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Start _get_guest_xml network_info=[{"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:10:57.808683 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:10:57.809303 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumesNegativeTest-instance-587703483', uuid='f0d03b72-1ffa-42e5-a030-b62157fbde9a'), owner=OwnerMeta(userid='43c0d7e3912b49158e917063a7b83487', username='tempest-VolumesNegativeTest-2020603875-project-member', projectid='c128de45147e4a778e1edeb549bc59f6', projectname='tempest-VolumesNegativeTest-2020603875'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772257.8088896) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:10:57.811092 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:10:57.811506 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:10:57.812307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:10:57.813050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:10:57.814423 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:10:57.814794 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:10:57.814794 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:10:57.814794 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:10:57.814880 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:10:57.840377 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-587703483',display_name='tempest-VolumesNegativeTest-instance-587703483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesnegativetest-instance-587703483',id=52,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c128de45147e4a778e1edeb549bc59f6',ramdisk_id='',reservation_id='r-v0o575e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2020603875',owner_user_name='tempest-VolumesNegativeTest-2020603875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:55Z,user_data=None,user_id='43c0d7e3912b49158e917063a7b83487',uuid=f0d03b72-1ffa-42e5-a030-b62157fbde9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:10:57.840377 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converting VIF {"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:57.840903 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:57.841783 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lazy-loading 'pci_devices' on Instance uuid f0d03b72-1ffa-42e5-a030-b62157fbde9a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:10:58.212177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-changed-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:10:58.212957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Refreshing instance network info cache due to event network-changed-33e6d629-7538-443f-bcee-d68cfb20c902. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:10:58.213410 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] Acquiring lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:10:58.213704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] Acquired lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:10:58.213816 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Refreshing network info cache for port 33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:10:58.306081 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:58.344330 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] End _get_guest_xml xml=<domain type="qemu">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <uuid>f0d03b72-1ffa-42e5-a030-b62157fbde9a</uuid>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <name>instance-00000034</name>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumesNegativeTest-instance-587703483</nova:name>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:10:57</nova:creationTime>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:user uuid="43c0d7e3912b49158e917063a7b83487">tempest-VolumesNegativeTest-2020603875-project-member</nova:user>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:project uuid="c128de45147e4a778e1edeb549bc59f6">tempest-VolumesNegativeTest-2020603875</nova:project>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         <nova:port uuid="234b5dca-9ec2-4718-aec3-c40df72b1688">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="192.168.233.201" ipVersion="4"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <system>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="serial">f0d03b72-1ffa-42e5-a030-b62157fbde9a</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="uuid">f0d03b72-1ffa-42e5-a030-b62157fbde9a</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </system>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <os>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </os>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <features>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </features>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   <devices>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.config"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </disk>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:6a:29:c8"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <target dev="tap234b5dca-9e"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </interface>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/console.log" append="off"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </serial>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <video>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </video>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </rng>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:   </devices>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]: </domain>
May 26 05:10:58.344330 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Preparing to wait for external event network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-587703483',display_name='tempest-VolumesNegativeTest-instance-587703483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesnegativetest-instance-587703483',id=52,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c128de45147e4a778e1edeb549bc59f6',ramdisk_id='',reservation_id='r-v0o575e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2020603875',owner_user_name='tempest-VolumesNegativeTest-2020603875-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:10:55Z,user_data=None,user_id='43c0d7e3912b49158e917063a7b83487',uuid=f0d03b72-1ffa-42e5-a030-b62157fbde9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converting VIF {"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:58.348228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:10:58.349207 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.349207 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc1aef20-2d91-5f03-9a14-69eb71c46667', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:58.349710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.350361 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:58.351726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.355009 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.355305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap234b5dca-9e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:58.355739 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap234b5dca-9e, col_values=(('qos', UUID('9ed696f3-3034-482a-8a28-afe35cc342b5')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:58.355956 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap234b5dca-9e, col_values=(('external_ids', {'iface-id': '234b5dca-9ec2-4718-aec3-c40df72b1688', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:29:c8', 'vm-uuid': 'f0d03b72-1ffa-42e5-a030-b62157fbde9a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:10:58.356972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.358600 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:10:58.363462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.365404 np0000001388 nova-compute[98319]: INFO os_vif [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e')
May 26 05:10:58.579038 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:10:58.716958 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:58.778864 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:58.978443 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Updated VIF entry in instance network info cache for port 234b5dca-9ec2-4718-aec3-c40df72b1688. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:58.978707 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Updating instance_info_cache with network_info: [{"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:59.176959 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:10:59.403069 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Updated VIF entry in instance network info cache for port 33e6d629-7538-443f-bcee-d68cfb20c902. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:10:59.403572 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Updating instance_info_cache with network_info: [{"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:10:59.481552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3f473581-26f3-4ff1-922f-38082b269ee7 req-928b977f-f9d5-41ac-b940-7ea8312e13bc service nova] Releasing lock "refresh_cache-f0d03b72-1ffa-42e5-a030-b62157fbde9a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:10:59.889372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:59.889595 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:10:59.889764 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] No VIF found with MAC fa:16:3e:6a:29:c8, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:10:59.890268 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Using config drive
May 26 05:10:59.905632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-95a6173a-e050-4c95-a4f1-22f70807808d req-e8773db4-70b5-4e19-8e70-086400556689 service nova] Releasing lock "refresh_cache-18b8f158-289d-4829-b892-766548f70009" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:00.324984 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:00.396577 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:00.504767 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Creating config drive at /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.config
May 26 05:11:00.509020 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bix72i8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:00.574292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp7bix72i8" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:01.047137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.052953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.112425 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.112694 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.205862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.317706 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e0df5f5c-c8cc-450b-b8a2-4f8e1e2fb875 req-32f3849e-ca40-4e5b-a080-b2084eb80caa service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:01.318498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0df5f5c-c8cc-450b-b8a2-4f8e1e2fb875 req-32f3849e-ca40-4e5b-a080-b2084eb80caa service nova] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:01.318789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0df5f5c-c8cc-450b-b8a2-4f8e1e2fb875 req-32f3849e-ca40-4e5b-a080-b2084eb80caa service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:01.319598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0df5f5c-c8cc-450b-b8a2-4f8e1e2fb875 req-32f3849e-ca40-4e5b-a080-b2084eb80caa service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:01.319598 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e0df5f5c-c8cc-450b-b8a2-4f8e1e2fb875 req-32f3849e-ca40-4e5b-a080-b2084eb80caa service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Processing event network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:11:01.453096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.458267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.477157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:01.915096 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:11:01.915896 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772261.915437, f0d03b72-1ffa-42e5-a030-b62157fbde9a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:01.916061 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] VM Started (Lifecycle Event)
May 26 05:11:01.919980 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:11:01.924034 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Instance spawned successfully.
May 26 05:11:01.924589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:11:02.419619 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:02.422875 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:02.434104 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.434273 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.434663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.434896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.435154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.435481 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:02.488218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:02.925455 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:11:02.925992 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772262.9254656, f0d03b72-1ffa-42e5-a030-b62157fbde9a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:02.925992 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] VM Paused (Lifecycle Event)
May 26 05:11:02.944110 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Took 7.27 seconds to spawn the instance on the hypervisor.
May 26 05:11:02.944284 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:03.358526 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:03.385369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:03.385598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:03.385767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:03.385907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:03.386024 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] No waiting events found dispatching network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:03.386152 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-849cc281-c33f-41d6-873c-e52e1ec1be41 req-7b3a8b13-a440-41df-8e31-2b39a9f7f062 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received unexpected event network-vif-plugged-234b5dca-9ec2-4718-aec3-c40df72b1688 for instance with vm_state active and task_state None.
May 26 05:11:03.428022 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:03.429824 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772263.4296057, f0d03b72-1ffa-42e5-a030-b62157fbde9a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:03.429975 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] VM Resumed (Lifecycle Event)
May 26 05:11:03.454874 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Took 12.65 seconds to build instance.
May 26 05:11:03.932091 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:03.933791 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:03.955661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:04.199875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:04.200056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:04.200111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:04.200335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:04.200476 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:04.202838 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Terminating instance
May 26 05:11:04.436698 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] During sync_power_state the instance has a pending task (deleting). Skip.
May 26 05:11:04.706229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:11:04.724268 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:04.728358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:04.746453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:04.748248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:04.769940 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:04.773434 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.052114 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999608867999996 future=<Future at 0x7d7ac464adb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:05.053740 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998736827999892 future=<Future at 0x7d7ac464adb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:05.053740 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99860001099978 future=<Future at 0x7d7ac464adb0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:05.055414 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Instance destroyed successfully.
May 26 05:11:05.055886 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lazy-loading 'resources' on Instance uuid f0d03b72-1ffa-42e5-a030-b62157fbde9a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:05.484107 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:05.484550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] No waiting events found dispatching network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Acquiring lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] No waiting events found dispatching network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:05.487363 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ac4799ed-cb33-4e70-9927-b1b1125935a3 req-506c041a-83bc-4cbc-b87e-0703284a172a service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-unplugged-234b5dca-9ec2-4718-aec3-c40df72b1688 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:11:05.559154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-587703483',display_name='tempest-VolumesNegativeTest-instance-587703483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumesnegativetest-instance-587703483',id=52,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:11:02Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c128de45147e4a778e1edeb549bc59f6',ramdisk_id='',reservation_id='r-v0o575e0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2020603875',owner_user_name='tempest-VolumesNegativeTest-2020603875-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:03Z,user_data=None,user_id='43c0d7e3912b49158e917063a7b83487',uuid=f0d03b72-1ffa-42e5-a030-b62157fbde9a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:11:05.559452 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converting VIF {"id": "234b5dca-9ec2-4718-aec3-c40df72b1688", "address": "fa:16:3e:6a:29:c8", "network": {"id": "3988b369-b20e-4892-a712-da6032056013", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.201", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "928da787e7674569a05e80c64a345a3e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap234b5dca-9e", "ovs_interfaceid": "234b5dca-9ec2-4718-aec3-c40df72b1688", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:05.560144 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:05.560440 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:11:05.561872 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.562144 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap234b5dca-9e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:05.563416 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.564245 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:05.564814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.565854 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.565995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9ed696f3-3034-482a-8a28-afe35cc342b5) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:05.566729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:05.567771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:05.569626 np0000001388 nova-compute[98319]: INFO os_vif [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:29:c8,bridge_name='br-int',has_traffic_filtering=True,id=234b5dca-9ec2-4718-aec3-c40df72b1688,network=Network(3988b369-b20e-4892-a712-da6032056013),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap234b5dca-9e')
May 26 05:11:05.569971 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Deleting instance files /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a_del
May 26 05:11:05.570779 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Deletion of /opt/stack/data/nova/instances/f0d03b72-1ffa-42e5-a030-b62157fbde9a_del complete
May 26 05:11:06.077009 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:11:06.078114 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:11:06.078384 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:11:06.078535 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:11:06.078821 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:06.198431 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:06.713178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:06.713331 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:06.892860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:06.892995 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:06.908228 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:07.216325 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:07.397291 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:07.410699 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Took 1.33 seconds to deallocate network for instance.
May 26 05:11:07.489614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:07.551280 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-caec68e6-a864-4d23-a38c-66373052af9f req-cbf227ee-579f-46e4-a2e6-1e148d62ac42 service nova] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Received event network-vif-deleted-234b5dca-9ec2-4718-aec3-c40df72b1688 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:07.917400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:07.917767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:08.151493 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:08.151729 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:08.221018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:08.403590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:08.654659 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:09.125167 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:09.161103 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:09.213789 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Deleted allocations for instance f0d03b72-1ffa-42e5-a030-b62157fbde9a
May 26 05:11:09.317826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:09.317826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:09.317826 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attaching volume 304812a7-5e07-438a-a652-1a4c1e12b90e to /dev/vdb
May 26 05:11:09.361012 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:09.372099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:11:09.401761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:09.458006 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:11:09.459169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:11:09.469425 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:11:09.471140 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:feeb:5704', 'fe80::5877:a6ff:fe1f:de24'] 
May 26 05:11:09.471140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:11:09.474398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:11:09.474398 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:09.474398 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating existing volume attachment record: 9bd13f6b-8044-4f5f-a528-8ca8af87da2e {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:11:09.569107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:09.570632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:09.570632 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Attaching volume 2df1f36c-c418-416f-acc1-5ac6c5ce9df5 to /dev/vdb
May 26 05:11:09.631415 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:09.648938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:11:09.673132 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:09.720958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:11:09.721213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:11:09.730436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:11:09.731477 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:feeb:5704', 'fe80::5877:a6ff:fe1f:de24'] 
May 26 05:11:09.731608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:11:09.731720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:11:09.731925 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:09.732136 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating existing volume attachment record: 3dcd0196-3e15-4fed-9e2d-8103d8858f7b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:11:10.024137 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:11:10.024137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:10.024137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:10.024137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:10.024137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:11:10.037428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:10.038060 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:10.038749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:10.038959 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:10.039486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:10.039891 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:10.049527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:10.049527 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:10.055554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:10.055554 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:10.063061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e] added
May 26 05:11:10.063061 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:10.063061 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:10.063061 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:10.063061 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:10.063061 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:10.063061 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:10.063436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:10.063501 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0245(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:10.063691 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:10.067439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e] added
May 26 05:11:10.067439 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:10.067439 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:10.067439 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:10.067439 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:10.067439 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:10.067439 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:10.067677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:10.067741 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.028(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:10.067895 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:10.224552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2171cc04-83e3-4394-80f0-8d8689f93b6d tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Lock "f0d03b72-1ffa-42e5-a030-b62157fbde9a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.024s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:10.299380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:11:10.299765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:10.299954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:10.567805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:11.011134 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:11.064171 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:11.068417 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:11.078381 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:11.078381 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:11.081762 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:11.081762 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:11.091886 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:11.098278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:11.107972 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:11:11.107972 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:11.108159 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:11:11.108159 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:11.108378 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:11:11.108378 np0000001388 nova-compute[98319]: 
May 26 05:11:11.114760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:11:11.114760 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:11.114920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:11:11.114920 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:11.114985 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:11:11.114985 np0000001388 nova-compute[98319]: 
May 26 05:11:12.139394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260]
May 26 05:11:12.139394 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260] successful.
May 26 05:11:12.139394 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:12.147775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260]
May 26 05:11:12.147775 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260] successful.
May 26 05:11:12.147775 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:12.159752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:12.168481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:12.176006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.176006 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.176006 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:12.176183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.176183 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.176183 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:12.176517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:12.176650 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:12.177212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('7', '-', '-', 0) found on session 133 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:12.177337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:12.185530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.185530 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.185530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:12.185742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.185742 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:12.185742 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:12.186114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:12.186317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:12.186973 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('8', '-', '-', 0) found on session 134 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:12.187128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:12.196576 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 133 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:12.196738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:12.204769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 134 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:12.490656 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:13.205566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 134 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:13.205990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:14.062603 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found WWN 3300000008f7ce9f2 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:11:14.063095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.039s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:14.063484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== connect_volume: return (4040ms) {'type': 'block', 'scsi_wwn': '3300000008f7ce9f2', 'path': '/dev/dm-0', 'multipath_id': '3300000008f7ce9f2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:14.063652 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f7ce9f2', 'path': '/dev/dm-0', 'multipath_id': '3300000008f7ce9f2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:11:14.063967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 3.764s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:14.064655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:11:14.067551 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:14.079847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:14.080450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:14.081429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:14.082431 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:14.083286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:14.083559 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:14.095320 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:14.095320 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:14.100786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:14.100786 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:14.107669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5] added
May 26 05:11:14.107669 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:14.107669 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:14.107669 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:14.107669 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:14.107669 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:14.107669 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:14.107925 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:14.108836 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:14.108836 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:14.113953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5] added
May 26 05:11:14.113953 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:14.113953 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:14.113953 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:14.113953 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:14.113953 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:14.113953 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:14.114169 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:14.114390 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0308(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:14.114520 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:14.570787 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attempting to attach volume 304812a7-5e07-438a-a652-1a4c1e12b90e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:11:14.572685 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:   <alias name="ua-304812a7-5e07-438a-a652-1a4c1e12b90e"/>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:   <serial>304812a7-5e07-438a-a652-1a4c1e12b90e</serial>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:14.572685 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:11:15.108933 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:15.115013 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:15.125803 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:15.125803 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:15.130597 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:15.130597 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.140809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.151032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.162356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.162356 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.162356 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:15.162569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.162569 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.162569 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:15.169801 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.169801 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.169801 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:15.170183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.170183 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.170183 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:15.203911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.40.100,3260]
May 26 05:11:15.203911 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.40.100,3260] successful.
May 26 05:11:15.203911 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.222783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.228433 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.50.100,3260]
May 26 05:11:15.228433 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.50.100,3260] successful.
May 26 05:11:15.228433 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.239236 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.239236 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.239236 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.239236 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.239236 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:15.239490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.239490 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.239490 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.239490 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.239490 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:15.239728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:15.239856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:15.240633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] HCTL ('9', '-', '-', 0) found on session 135 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:15.240763 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:15.241765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:15.264456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.264456 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.264456 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.264456 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.264456 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:15.265078 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.265078 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:15.265078 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.265078 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:15.265078 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:15.265521 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:15.265764 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:15.266666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] HCTL ('10', '-', '-', 0) found on session 136 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:15.268899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:15.269817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching for a device in session 135 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:15.269993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:15.288465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:15.417672 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:15.568403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:16.256969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:16.257539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:16.257539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:16.257539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:ed:b3:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:16.289187 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching for a device in session 136 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:16.289435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:17.100927 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found WWN 330000000e6cc9f8e for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:11:17.101241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:17.101490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== connect_volume: return (6801ms) {'type': 'block', 'scsi_wwn': '330000000e6cc9f8e', 'path': '/dev/dm-1', 'multipath_id': '330000000e6cc9f8e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:17.101679 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e6cc9f8e', 'path': '/dev/dm-1', 'multipath_id': '330000000e6cc9f8e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:11:17.104439 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:17.268161 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:17.492453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:17.607079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Attempting to attach volume 2df1f36c-c418-416f-acc1-5ac6c5ce9df5 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:11:17.608254 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:   <alias name="ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5"/>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:   <serial>2df1f36c-c418-416f-acc1-5ac6c5ce9df5</serial>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:17.608254 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:11:17.812550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-959e2cfa-eaee-43ec-8f02-f43280a10eea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.495s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:18.199798 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:18.200000 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:18.200144 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:18.206159 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 26 05:11:18.206159 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:19.230712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.232126 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.253436 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.257435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.280116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.280841 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:19.294123 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:19.294316 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:19.294463 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:19.294562 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No VIF found with MAC fa:16:3e:e2:97:44, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:19.577865 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999511726000037 future=<Future at 0x7d7aa44027e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:19.581057 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance destroyed successfully.
May 26 05:11:19.582015 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'numa_topology' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:19.975946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:20.052226 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004872310000791913 future=<Future at 0x7d7ac464adb0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:20.052936 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] Emitting event <LifecycleEvent: 1779772265.0515676, f0d03b72-1ffa-42e5-a030-b62157fbde9a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:20.053153 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:20.053321 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.523890151999694 future=<Future at 0x7d7aa44027e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:20.053780 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.523758275000091 future=<Future at 0x7d7aa44027e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:20.053780 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] VM Stopped (Lifecycle Event)
May 26 05:11:20.084037 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:20.084218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:20.557159 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2101a60b-b58d-4d92-9e91-4218116dff6b tempest-VolumesSnapshotTestJSON-805170533 tempest-VolumesSnapshotTestJSON-805170533-project-member] [instance: f0d03b72-1ffa-42e5-a030-b62157fbde9a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:20.570710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:20.592929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6089f68d-0203-411a-9076-399fcec6d182 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.392s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:20.878293 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5ebe617e-b3a7-4479-8fbd-ab40696fb923 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.308s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:20.971027 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:21.479067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:21.479356 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquired lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:21.479653 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:11:21.479982 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'info_cache' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:21.984515 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:22.475824 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:22.478794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:22.478926 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:22.479082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:22.479219 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:22.479748 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-26b4f87a-5cdc-4e50-9f2d-0d214f80008d req-c7fb050a-6dea-45a2-a8fc-b9e7da9449db service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state stopped and task_state powering-on.
May 26 05:11:22.487018 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:22.493120 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:22.901733 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:23.071109 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:23.573770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Releasing lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:23.830764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:24.551056 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:24.554444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:24.554444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:24.554444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:24.554444 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:24.554444 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b3799d9e-5a1b-4ac1-b7b4-631ca1d0872a req-110c847b-396d-4aa9-b54b-94fe162a40c4 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state stopped and task_state powering-on.
May 26 05:11:24.594509 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance destroyed successfully.
May 26 05:11:24.595228 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'numa_topology' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:25.097557 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:25.097851 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'resources' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:25.573940 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:25.599788 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:25.600797 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:11:25.601093 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:25.601981 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:25.602757 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:11:25.603929 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:25.604080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfdef0e4-27, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:25.605178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:25.606118 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:25.606968 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:25.607107 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a517629a-85a9-4f8b-b18b-32b6ea41a624) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:25.608102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:25.609166 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:25.611278 np0000001388 nova-compute[98319]: INFO os_vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:11:25.613050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:11:25.613613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:25.613811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:25.614253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:25.614873 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:11:25.615144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:11:25.645874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:25.645874 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:25.645874 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:25.645874 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:25.645874 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:25.646118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [133] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:25.646118 np0000001388 nova-compute[98319]: tcp: [134] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:25.646118 np0000001388 nova-compute[98319]: tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:25.646118 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:25.646118 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:25.646337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '133'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '134'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '136')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:11:25.646475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '134')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:25.648138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '133')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:25.648138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4591620>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:11:25.648431 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:11:25.648591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flush multipath device 3300000008f7ce9f2 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:11:25.684303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:25.733111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:25.761845 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:25.762183 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:25.773749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:11:25.774263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:11:25.775204 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:11:25.790704 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:11:25.791071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:11:25.805103 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.839148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 134, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260]
May 26 05:11:25.839148 np0000001388 nova-compute[98319]: Logout of [sid: 134, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260] successful.
May 26 05:11:25.839148 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.854148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.869652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.897564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 133, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260]
May 26 05:11:25.897564 np0000001388 nova-compute[98319]: Logout of [sid: 133, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260] successful.
May 26 05:11:25.897564 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.915368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:25.915516 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:25.915721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== disconnect_volume: return (301ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:25.915767 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:11:25.926262 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start _get_guest_xml network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': '9bd13f6b-8044-4f5f-a528-8ca8af87da2e', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': 'fc92f62b-3d3a-4e8b-a981-8a57840fb928', 'attached_at': '', 'detached_at': '', 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'serial': '304812a7-5e07-438a-a652-1a4c1e12b90e'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:11:25.928268 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:11:25.929732 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-800092940', uuid='fc92f62b-3d3a-4e8b-a981-8a57840fb928'), owner=OwnerMeta(userid='6abb55160a21467e8a9137d4790b90ad', username='tempest-AttachVolumeTestJSON-1676547055-project-member', projectid='2efc51fa90bd472aa54bd9d44b862522', projectname='tempest-AttachVolumeTestJSON-1676547055'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772285.9293077) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:11:25.932049 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:11:25.932484 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:11:25.933329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:11:25.933583 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:11:25.934629 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:11:25.935022 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:11:25.935117 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:11:25.935257 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:11:25.935435 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:11:25.935551 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:11:25.935680 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:11:25.935866 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:11:25.936000 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:11:25.936141 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:11:25.936391 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:11:25.936552 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:11:25.936724 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:26.267831 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Detaching volume 2df1f36c-c418-416f-acc1-5ac6c5ce9df5
May 26 05:11:26.313799 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Attempting to driver detach volume 2df1f36c-c418-416f-acc1-5ac6c5ce9df5 from mountpoint /dev/vdb
May 26 05:11:26.318099 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found disk vdb by alias ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:11:26.319561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found disk vdb by alias ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:11:26.319561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Attempting to detach device vdb from instance 7c3de26e-7807-4a99-943a-474537f0e547 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:11:26.319561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <alias name="ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5"/>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <serial>2df1f36c-c418-416f-acc1-5ac6c5ce9df5</serial>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:26.319561 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:11:26.326044 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully detached device vdb from instance 7c3de26e-7807-4a99-943a-474537f0e547 from the persistent domain config.
May 26 05:11:26.326044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] (1/8): Attempting to detach device vdb with device alias ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 from instance 7c3de26e-7807-4a99-943a-474537f0e547 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:11:26.326044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <alias name="ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5"/>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <serial>2df1f36c-c418-416f-acc1-5ac6c5ce9df5</serial>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:26.326044 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:11:26.438734 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:26.450972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:26.557138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:26.558519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:26.558519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:26.559064 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:26.559667 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:11:26.560228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:26.560544 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:26.878930 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772286.8781211, 7c3de26e-7807-4a99-943a-474537f0e547 => ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:11:26.879697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 for instance 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:11:26.882654 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully detached device vdb from instance 7c3de26e-7807-4a99-943a-474537f0e547 from the live domain config.
May 26 05:11:26.884477 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:11:26.884847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:26.885021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:27.105350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:27.495611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:28.122109 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:28.122782 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:28.123052 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:29.217707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.657s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:29.217707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:11:29.229883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:29.231051 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:29.231847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:29.232733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:29.233276 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:29.233461 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:29.244648 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:29.244648 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:29.246431 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:29.246431 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e] added
May 26 05:11:29.258235 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:29.258235 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:29.258235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:29.258852 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0259(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:29.258852 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:29.264147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e] added
May 26 05:11:29.264147 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:29.264147 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:29.264147 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:29.264147 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:29.264147 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:29.264147 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:29.264489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:29.264489 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0316(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:29.264605 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:29.618018 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:29.618399 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:29.618685 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:29.929862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:30.258985 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:30.265001 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:30.271218 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:30.271218 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:30.280028 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:30.280028 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.284951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.292506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.301066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.301066 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.301066 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.301066 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.301066 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:30.301241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.301241 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.301241 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.301241 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.301241 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:30.305384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.305384 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.305384 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.305384 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.305384 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:30.305530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.305530 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.305530 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.305530 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.305530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:30.340355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260]
May 26 05:11:30.340355 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260] successful.
May 26 05:11:30.340355 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.348687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260]
May 26 05:11:30.348687 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260] successful.
May 26 05:11:30.348687 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.353489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.361214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.368341 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.368522 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:30.368823 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:30.368986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:30.369850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('11', '-', '-', 0) found on session 139 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:30.370088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.376817 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:30.377088 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:30.377258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:30.377629 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:30.378359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('12', '-', '-', 0) found on session 140 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:30.378516 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:30.383921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 139 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:30.384110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:30.390994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 140 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:30.391059 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:30.501547 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:30.503507 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:30.608784 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:31.231334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:11:31.617789 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:31.618366 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:32.248023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found WWN 3300000008f7ce9f2 for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:11:32.248321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:32.248515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== connect_volume: return (5687ms) {'type': 'block', 'scsi_wwn': '3300000008f7ce9f2', 'path': '/dev/dm-2', 'multipath_id': '3300000008f7ce9f2'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:32.248649 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008f7ce9f2', 'path': '/dev/dm-2', 'multipath_id': '3300000008f7ce9f2'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:11:32.249238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.364s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:32.250126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:11:32.250126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [135] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [136] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5 (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [137] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [138] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:32.282222 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '135'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '136'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '137'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '138'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '140')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '135')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5', '136')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa434e160>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:11:32.282222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flush multipath device 330000000e6cc9f8e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:11:32.320436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:32.372804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:32.431693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:11:32.431693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:11:32.431693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:11:32.443509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:11:32.443509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:11:32.457115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.486788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 135, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.40.100,3260]
May 26 05:11:32.486788 np0000001388 nova-compute[98319]: Logout of [sid: 135, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.40.100,3260] successful.
May 26 05:11:32.486788 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.495395 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:32.505004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.517884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.554609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 136, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.50.100,3260]
May 26 05:11:32.554609 np0000001388 nova-compute[98319]: Logout of [sid: 136, target: iqn.2023-03.storpool.com:os--volume-2df1f36c-c418-416f-acc1-5ac6c5ce9df5, portal: 192.168.50.100,3260] successful.
May 26 05:11:32.554609 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.568889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:32.572229 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:32.572229 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== disconnect_volume: return (5684ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:32.572229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:11:32.617855 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:32.618221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:11:32.622514 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:32.680800 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:32.757026 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:11:32.757269 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:32.757990 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:32.758910 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'pci_devices' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:33.132706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:33.132903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:33.133041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:33.133173 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:11:33.135750 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:33.260826 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:33.262009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] End _get_guest_xml xml=<domain type="qemu">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <uuid>fc92f62b-3d3a-4e8b-a981-8a57840fb928</uuid>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <name>instance-00000031</name>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-800092940</nova:name>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:11:25</nova:creationTime>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:user uuid="6abb55160a21467e8a9137d4790b90ad">tempest-AttachVolumeTestJSON-1676547055-project-member</nova:user>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:project uuid="2efc51fa90bd472aa54bd9d44b862522">tempest-AttachVolumeTestJSON-1676547055</nova:project>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         <nova:port uuid="bfdef0e4-27d9-4463-86ac-f670c1ec4b71">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <system>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="serial">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="uuid">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </system>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <os>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </os>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <features>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </features>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   <devices>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <alias name="ua-304812a7-5e07-438a-a652-1a4c1e12b90e"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-2"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <serial>304812a7-5e07-438a-a652-1a4c1e12b90e</serial>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ed:b3:54"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <target dev="tapbfdef0e4-27"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </interface>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/console.log" append="off"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </serial>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <video>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </video>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </rng>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:   </devices>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]: </domain>
May 26 05:11:33.262009 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:11:33.264242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:33.363681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:33.363681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:33.468783 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:33.469265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] skipping disk /dev/dm-2 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:11:33.469928 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:33.972159 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:33.972662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.091749 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.093169 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:11:34.093169 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.145551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0a37b2f6-778d-4267-bc1b-d38049595482 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 8.383s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:34.163981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.189266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.190598 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Cannot resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:11:34.191062 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'migration_context' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:34.263045 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.263521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.338685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.355475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.365482 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.460681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.461322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.559550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.563730 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:11:34.565115 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:34.578741 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0014289740001913742 future=<Future at 0x7d7aa44027e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:34.578922 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:34.579807 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] Emitting event <LifecycleEvent: 1779772279.5771344, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:34.580188 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Stopped (Lifecycle Event)
May 26 05:11:34.611844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.047s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:34.612310 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13615MB free_disk=72.82201766967773GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:11:34.612547 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:34.612744 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:34.697979 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:11:34.699146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:11:34.699425 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:34.700135 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:34.700434 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:11:34.702248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.702248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:34.702381 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:11:34.703089 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.703305 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b00f62d6-44a2-5004-b87c-0cb22ff45837', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:34.704133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.705104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:34.709088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.709587 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfdef0e4-27, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:34.709934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfdef0e4-27, col_values=(('qos', UUID('4e797843-89b7-4811-adb4-1eb26e25c25a')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:34.710138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfdef0e4-27, col_values=(('external_ids', {'iface-id': 'bfdef0e4-27d9-4463-86ac-f670c1ec4b71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b3:54', 'vm-uuid': 'fc92f62b-3d3a-4e8b-a981-8a57840fb928'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:34.711005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.712289 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:34.717995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:34.719364 np0000001388 nova-compute[98319]: INFO os_vif [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:11:35.085307 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-04bff5d2-c8e6-43c4-b7c5-70e66ba204a5 tempest-VolumesNegativeTest-2020603875 tempest-VolumesNegativeTest-2020603875-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:35.187254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.209407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.212626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.318935 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.422593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:35.424394 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:35.566176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.569799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.586419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:35.688063 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:11:35.688270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7c3de26e-7807-4a99-943a-474537f0e547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:11:35.688355 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 18b8f158-289d-4829-b892-766548f70009 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:11:35.688608 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:11:35.688819 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:11:34 up 43 min,  2 users,  load average: 4.26, 5.97, 4.66\n', 'num_instances': '3', 'num_vm_stopped': '1', 'num_task_powering-on': '1', 'num_os_type_None': '3', 'num_proj_2efc51fa90bd472aa54bd9d44b862522': '1', 'io_workload': '0', 'num_vm_active': '2', 'num_task_None': '2', 'num_proj_e8032d6bd9bb4c029e534ebae5756f21': '1', 'num_proj_23047976f3814538912524932a6a9375': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:11:35.914849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:35.915059 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:35.927052 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:36.025770 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772296.0253828, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:36.025976 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Resumed (Lifecycle Event)
May 26 05:11:36.026942 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:11:36.031068 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance rebooted successfully.
May 26 05:11:36.421030 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:36.529659 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:36.538147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:36.930063 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:11:36.930283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.317s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:36.930660 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:36.933449 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:37.040569 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:11:37.040819 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772297.0406353, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:37.040931 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Started (Lifecycle Event)
May 26 05:11:37.354827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:37.354984 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:37.497036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:37.542449 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:37.542632 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:37.542720 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:37.542775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:ed:b3:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:37.543117 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f5a0fadf-2ade-4c55-ab3a-bc0ceb5ea630 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:37.548090 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:37.549836 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:37.557871 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:37.799714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:37.799903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:37.813793 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:11:37.814107 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.80 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:37.856638 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:11:38.011848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:38.012032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:38.012224 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Attaching volume b7af21f6-ec42-4732-98d6-4b66d56d59b3 to /dev/vdb
May 26 05:11:38.053548 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:11:38.063550 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:38.064770 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] instance snapshotting
May 26 05:11:38.076831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:11:38.098296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:38.148451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:11:38.148860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:11:38.157183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:11:38.159395 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:feeb:5704', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:11:38.159558 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:11:38.159645 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:11:38.159867 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:38.160089 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Updating existing volume attachment record: 90324d89-bbc8-41e1-b7a8-df9f084c5524 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:11:38.191144 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Beginning live snapshot process
May 26 05:11:38.301485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:11:38.408676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:38.408901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:38.413536 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:11:38.413658 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Claim successful on node np0000001388
May 26 05:11:38.716917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:11:38.717320 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:38.717483 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:38.717885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:38.718071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:11:38.729785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:38.730416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:38.731414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:38.732175 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:38.732476 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:38.732598 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:38.743892 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:38.743892 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:38.750629 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:11:38.750629 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:38.757465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3] added
May 26 05:11:38.757465 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:38.757465 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:38.757465 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:38.757465 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:38.757465 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:38.757465 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:38.757862 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:38.757908 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:38.758104 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:38.762234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3] added
May 26 05:11:38.762234 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:11:38.762234 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:38.762234 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:38.762234 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:11:38.762234 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:11:38.762234 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:38.762610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:11:38.762610 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0301(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:11:38.762610 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:11:38.852030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:39.513597 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:39.513826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:39.514116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:39.514116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:39.514281 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:39.514452 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8c5da750-9aff-4e81-a438-95c7beb3b89b req-5e7e6385-08ee-4699-9b1f-f0dafb442b0d service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state active and task_state None.
May 26 05:11:39.703616 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:39.718359 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:39.758751 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:11:39.762998 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:39.772216 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:39.772216 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:11:39.781910 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:11:39.781910 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.786218 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:39.786436 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:39.788608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.791457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json -f qcow2" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:39.791848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json -f qcow2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:39.807094 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.810404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.810404 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.810404 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:39.811745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.811745 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.811745 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:39.822594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.822594 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.822594 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:39.822787 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.822787 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.822787 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:39.854840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.40.100,3260]
May 26 05:11:39.854840 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.40.100,3260] successful.
May 26 05:11:39.854840 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.866609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.871125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.50.100,3260]
May 26 05:11:39.871125 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.50.100,3260] successful.
May 26 05:11:39.871125 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.881565 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.881565 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.881565 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.881565 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.881565 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:39.881728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.881728 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.881728 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.881728 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.881728 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:39.882250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:39.882418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:39.883244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('7', '-', '-', 0) found on session 141 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:39.883472 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:39.887634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:39.890470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json -f qcow2" returned: 0 in 0.099s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:39.891165 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:39.895112 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:39.895848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:39.915297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.915297 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.915297 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.915297 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.915297 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:39.915575 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.915575 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:39.915575 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.915575 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:39.915575 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:39.917103 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:39.917653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 141 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:39.917934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:39.918646 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:11:39.919417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('8', '-', '-', 0) found on session 142 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:11:39.919590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:11:39.936507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 142 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:11:39.936663 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:11:39.981675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:39.982092 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8.delta 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:40.052343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8.delta 1073741824" returned: 0 in 0.070s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:40.053032 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Quiescing instance not available: QEMU guest agent is not enabled.
May 26 05:11:40.290611 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:40.309633 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] COPY block job progress, current cursor: 0 final cursor: 76808192 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 05:11:40.731838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:11:40.800905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.392s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:40.801912 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.949s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:40.802167 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:11:40.808128 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:11:40.808238 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Claim successful on node np0000001388
May 26 05:11:40.813871 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] COPY block job progress, current cursor: 76808192 final cursor: 76808192 {{(pid=98319) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}}
May 26 05:11:40.817943 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Skipping quiescing instance: QEMU guest agent is not enabled.
May 26 05:11:40.860482 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:11:40.860967 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8.delta /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:41.083795 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8.delta /opt/stack/data/nova/instances/snapshots/tmpy22j_riz/a6e6bc6430f64586b72b423eb856d7e8" returned: 0 in 0.222s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:41.088411 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Snapshot extracted, beginning image upload
May 26 05:11:41.309965 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:11:41.310270 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:11:41.310807 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:41.311116 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:41.397235 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f737dd526dff4402bb2deb8e2fe56f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495b51ea0c0f4e2f996fbd7a5ccdf223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:11:41.572152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:41.572710 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:41.573417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:41.573581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:41.573800 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:41.573976 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d3baad97-4a8b-4897-89fc-6d2e5f993287 req-07a74934-38be-4438-997b-76c38e2781ef service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state active and task_state None.
May 26 05:11:41.749789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found WWN 330000000c642c02e for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:11:41.750320 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:41.750664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000c642c02e', 'path': '/dev/dm-0', 'multipath_id': '330000000c642c02e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:41.750944 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c642c02e', 'path': '/dev/dm-0', 'multipath_id': '330000000c642c02e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:11:41.761418 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:41.816006 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:11:41.864457 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Successfully created port: edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:11:41.889319 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:11:42.151638 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:42.151976 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:42.269565 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Attempting to attach volume b7af21f6-ec42-4732-98d6-4b66d56d59b3 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:11:42.271019 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:   <alias name="ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3"/>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:   <serial>b7af21f6-ec42-4732-98d6-4b66d56d59b3</serial>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:42.271019 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:11:42.327902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:11:42.415373 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Successfully updated port: edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:11:42.477488 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-changed-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:42.477830 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Refreshing instance network info cache due to event network-changed-edd2a050-ed3e-4a7e-bba0-d389044b0211. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:11:42.477928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] Acquiring lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:42.478344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] Acquired lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:42.478527 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Refreshing network info cache for port edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:11:42.508619 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:42.655289 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:42.919921 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:42.982749 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:43.060313 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:43.165221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.364s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:43.169450 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:11:43.243892 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:43.343042 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:11:43.343953 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:11:43.344629 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Creating image(s)
May 26 05:11:43.344629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:43.344826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:43.345158 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:43.345664 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:43.348966 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:43.351856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:43.447585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:43.448065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:43.448691 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:43.455707 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:43.460875 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:43.461401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:43.575447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.114s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:43.575836 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:43.638770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk 1073741824" returned: 0 in 0.063s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:43.640935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:43.640935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:43.682834 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:11:43.683082 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:11:43.684051 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:43.684772 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:43.747773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03322c6d-4267-45ff-9379-2a67c714064e req-d1ae69e2-7da0-42b7-996b-f75cbce6136a service nova] Releasing lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:43.747773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquired lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:43.747773 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:11:43.755849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.116s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:43.757414 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:11:43.757497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:43.789590 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60af843351d74dd9b068b684da8584fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa9e17bf6d4b99856c025e45c86c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:11:43.880173 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json" returned: 0 in 0.122s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:43.880477 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Cannot resize image /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:11:43.881104 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:11:43.881104 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Ensure instance console log exists: /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:11:43.883073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:43.883073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:43.883073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:43.956067 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Snapshot image upload complete
May 26 05:11:43.956563 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bccf8abb-415d-4f22-bbf6-ce9766d7ea9b tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Took 5.89 seconds to snapshot the instance on the hypervisor.
May 26 05:11:43.963948 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:43.964085 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:43.964167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:43.964326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:eb:57:04, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:44.191081 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:11:44.292923 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Successfully created port: 1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:11:44.324318 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:44.508147 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:44.656304 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating instance_info_cache with network_info: [{"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:44.694427 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:11:44.721114 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:44.790470 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Successfully updated port: 1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:11:44.849460 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-changed-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:44.849994 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Refreshing instance network info cache due to event network-changed-1678249e-44d9-4d42-bea2-58e8e69636a7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:11:44.850348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] Acquiring lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:44.850520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] Acquired lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:44.850696 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Refreshing network info cache for port 1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:11:45.158597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Releasing lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:45.159103 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance network_info: |[{"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:11:45.163707 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Start _get_guest_xml network_info=[{"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:11:45.168252 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:11:45.169617 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1632108657', uuid='c9d84182-2ad2-4572-b3f6-94312da22283'), owner=OwnerMeta(userid='f737dd526dff4402bb2deb8e2fe56f2b', username='tempest-TestEncryptedCinderVolumes-2040747730-project-member', projectid='495b51ea0c0f4e2f996fbd7a5ccdf223', projectname='tempest-TestEncryptedCinderVolumes-2040747730'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772305.1691773) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:11:45.172989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:11:45.173344 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:11:45.175143 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:11:45.178064 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:11:45.178604 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:11:45.178809 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:11:45.189216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1632108657',display_name='tempest-TestEncryptedCinderVolumes-server-1632108657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1632108657',id=53,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWMoKtKTSC++YDNdQ3lR7ngUZBlaToG0Tq29ELa8ZPrZeLBY/r8dEObAF/8eymHzJCNWQ+Qr/55G1oEl0KMWlzixaSOR45bfmfg1nbezHe1UZZf3/YIZb8I8vRdBdcMDw==',key_name='tempest-keypair-388808548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-9jvemevy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9d84182-2ad2-4572-b3f6-94312da22283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:11:45.189623 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:45.190358 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:45.191023 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'pci_devices' on Instance uuid c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:45.292694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:45.353105 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:45.429068 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:45.549521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9be2e111-89d0-4564-8afa-a842addc8420 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.537s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:45.613026 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] End _get_guest_xml xml=<domain type="qemu">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <uuid>c9d84182-2ad2-4572-b3f6-94312da22283</uuid>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <name>instance-00000035</name>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1632108657</nova:name>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:11:45</nova:creationTime>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:user uuid="f737dd526dff4402bb2deb8e2fe56f2b">tempest-TestEncryptedCinderVolumes-2040747730-project-member</nova:user>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:project uuid="495b51ea0c0f4e2f996fbd7a5ccdf223">tempest-TestEncryptedCinderVolumes-2040747730</nova:project>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         <nova:port uuid="edd2a050-ed3e-4a7e-bba0-d389044b0211">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <system>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="serial">c9d84182-2ad2-4572-b3f6-94312da22283</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="uuid">c9d84182-2ad2-4572-b3f6-94312da22283</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </system>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <os>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </os>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <features>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </features>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   <devices>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.config"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:15:de:36"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <target dev="tapedd2a050-ed"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </interface>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/console.log" append="off"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </serial>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <video>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </video>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </rng>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:   </devices>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: </domain>
May 26 05:11:45.696005 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Preparing to wait for external event network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1632108657',display_name='tempest-TestEncryptedCinderVolumes-server-1632108657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1632108657',id=53,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWMoKtKTSC++YDNdQ3lR7ngUZBlaToG0Tq29ELa8ZPrZeLBY/r8dEObAF/8eymHzJCNWQ+Qr/55G1oEl0KMWlzixaSOR45bfmfg1nbezHe1UZZf3/YIZb8I8vRdBdcMDw==',key_name='tempest-keypair-388808548',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-9jvemevy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9d84182-2ad2-4572-b3f6-94312da22283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:45.696005 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:11:45.698292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:45.698292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:45.698292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:11:45.700102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:45.700333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1b8b241e-05c4-5324-bbf8-507de25967c1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:45.702392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:11:45.703402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:11:45.704831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:45.706760 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Creating image(s)
May 26 05:11:45.707665 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:45.708004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:45.708526 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:45.709104 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:45.712701 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:45.713775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:45.733081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:45.733081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedd2a050-ed, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:45.733407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedd2a050-ed, col_values=(('qos', UUID('f3f49199-d939-4d7f-9d4a-c27bbbbde454')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:45.733502 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedd2a050-ed, col_values=(('external_ids', {'iface-id': 'edd2a050-ed3e-4a7e-bba0-d389044b0211', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:de:36', 'vm-uuid': 'c9d84182-2ad2-4572-b3f6-94312da22283'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:45.738514 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:45.740978 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:45.743014 np0000001388 nova-compute[98319]: INFO os_vif [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed')
May 26 05:11:45.805769 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:45.806302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:45.807258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:45.807742 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:45.810310 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:45.810668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:45.906521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:45.907034 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:45.976097 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk 1073741824" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:45.976603 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:45.976934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:46.009284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:46.009284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:46.067067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:46.067613 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking if we can resize image /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:11:46.067968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:46.117270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cad9d5ac-42d6-4763-9d1c-d93b65a507be req-54a59f9b-d145-4029-9466-f1ea720bdc50 service nova] Releasing lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:46.117817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquired lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:46.118106 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:11:46.184943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:46.185455 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Cannot resize image /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:11:46.185728 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:11:46.186007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Ensure instance console log exists: /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:11:46.186520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:46.186791 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:46.186972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:46.446833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:46.447043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:46.512906 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Detaching volume b7af21f6-ec42-4732-98d6-4b66d56d59b3
May 26 05:11:46.555267 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Attempting to driver detach volume b7af21f6-ec42-4732-98d6-4b66d56d59b3 from mountpoint /dev/vdb
May 26 05:11:46.561744 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:11:46.563550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:11:46.563550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Attempting to detach device vdb from instance 18b8f158-289d-4829-b892-766548f70009 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:11:46.563550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <alias name="ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3"/>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <serial>b7af21f6-ec42-4732-98d6-4b66d56d59b3</serial>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:46.563550 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:11:46.568576 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 18b8f158-289d-4829-b892-766548f70009 from the persistent domain config.
May 26 05:11:46.568820 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] (1/8): Attempting to detach device vdb with device alias ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3 from instance 18b8f158-289d-4829-b892-766548f70009 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:11:46.569124 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <alias name="ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3"/>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <serial>b7af21f6-ec42-4732-98d6-4b66d56d59b3</serial>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]: </disk>
May 26 05:11:46.569124 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:11:46.684401 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:46.871063 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:46.948998 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:11:47.027756 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating instance_info_cache with network_info: [{"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:47.160230 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772307.1597853, 18b8f158-289d-4829-b892-766548f70009 => ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:11:47.161225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b7af21f6-ec42-4732-98d6-4b66d56d59b3 for instance 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:11:47.163404 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 18b8f158-289d-4829-b892-766548f70009 from the live domain config.
May 26 05:11:47.164044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:11:47.164448 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:11:47.164739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:11:47.165712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:11:47.165712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b7af21f6-ec42-4732-98d6-4b66d56d59b3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:11:47.165712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:11:47.189033 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:47.189033 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:47.189033 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:47.189033 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:47.189033 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: tcp: [141] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: tcp: [142] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3 (non-flash)
May 26 05:11:47.191450 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '140'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', '141'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', '142')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', '141')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3', '142')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:11:47.191450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac44232e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:11:47.191958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:11:47.192283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flush multipath device 330000000c642c02e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:11:47.222819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:47.264777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:11:47.269313 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:47.269437 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:47.269537 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:15:de:36, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:47.269971 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Using config drive
May 26 05:11:47.311783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:11:47.311783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:11:47.311783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:11:47.322460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:11:47.324717 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:11:47.334700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.367148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 141, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.40.100,3260]
May 26 05:11:47.367148 np0000001388 nova-compute[98319]: Logout of [sid: 141, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.40.100,3260] successful.
May 26 05:11:47.367148 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.382566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.393247 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.421489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 142, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.50.100,3260]
May 26 05:11:47.421489 np0000001388 nova-compute[98319]: Logout of [sid: 142, target: iqn.2023-03.storpool.com:os--volume-b7af21f6-ec42-4732-98d6-4b66d56d59b3, portal: 192.168.50.100,3260] successful.
May 26 05:11:47.421489 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.435496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:11:47.435496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:11:47.435496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== disconnect_volume: return (270ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:11:47.435496 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:11:47.497090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:47.497318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:47.500325 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:11:47.500464 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Claim successful on node np0000001388
May 26 05:11:47.511403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:47.530331 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Releasing lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:47.530553 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance network_info: |[{"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:11:47.533054 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Start _get_guest_xml network_info=[{"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:11:47.535977 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:11:47.537544 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-2042341956', uuid='698fc8bc-90d2-4b82-a7ae-6bcc20b253e5'), owner=OwnerMeta(userid='60af843351d74dd9b068b684da8584fc', username='tempest-TestEncryptedCinderVolumes-2082837232-project-member', projectid='71aa9e17bf6d4b99856c025e45c86c48', projectname='tempest-TestEncryptedCinderVolumes-2082837232'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772307.537043) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:11:47.538990 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:11:47.539431 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:11:47.540365 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:11:47.540582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:11:47.541644 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:11:47.542027 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:11:47.542236 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:11:47.542366 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:11:47.542521 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:11:47.542672 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:11:47.542784 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:11:47.542990 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:11:47.543102 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:11:47.543251 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:11:47.543386 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:11:47.543528 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:11:47.559480 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042341956',display_name='tempest-TestEncryptedCinderVolumes-server-2042341956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-2042341956',id=54,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW6dVJIUO6pdKslXrj2Y1vOjdqPaA7Bss7zzYK7FdUvg8dmtbzVMHHiLfKjUUXgu9E3oi65x42Bq749xHQvSs4hxGGquIogCK33vGFgJFAJDa8vMQaa2bTuQlZ0B3h2aA==',key_name='tempest-keypair-1677756276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-djb4wtkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60af843351d74dd9b068b684da8584fc',uuid=698fc8bc-90d2-4b82-a7ae-6bcc20b253e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:11:47.559948 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:47.560684 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:47.561364 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'pci_devices' on Instance uuid 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:47.776047 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:47.880098 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Creating config drive at /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.config
May 26 05:11:47.883777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplivt_2d8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:47.943175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplivt_2d8" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:47.990160 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] End _get_guest_xml xml=<domain type="qemu">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <uuid>698fc8bc-90d2-4b82-a7ae-6bcc20b253e5</uuid>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <name>instance-00000036</name>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-2042341956</nova:name>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:11:47</nova:creationTime>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:user uuid="60af843351d74dd9b068b684da8584fc">tempest-TestEncryptedCinderVolumes-2082837232-project-member</nova:user>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:project uuid="71aa9e17bf6d4b99856c025e45c86c48">tempest-TestEncryptedCinderVolumes-2082837232</nova:project>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         <nova:port uuid="1678249e-44d9-4d42-bea2-58e8e69636a7">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <system>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="serial">698fc8bc-90d2-4b82-a7ae-6bcc20b253e5</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="uuid">698fc8bc-90d2-4b82-a7ae-6bcc20b253e5</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </system>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <os>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </os>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <features>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </features>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   <devices>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.config"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:8d:34:41"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <target dev="tap1678249e-44"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </interface>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/console.log" append="off"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </serial>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <video>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </video>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </rng>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:   </devices>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: </domain>
May 26 05:11:48.066408 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Preparing to wait for external event network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:48.066408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042341956',display_name='tempest-TestEncryptedCinderVolumes-server-2042341956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-2042341956',id=54,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW6dVJIUO6pdKslXrj2Y1vOjdqPaA7Bss7zzYK7FdUvg8dmtbzVMHHiLfKjUUXgu9E3oi65x42Bq749xHQvSs4hxGGquIogCK33vGFgJFAJDa8vMQaa2bTuQlZ0B3h2aA==',key_name='tempest-keypair-1677756276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-djb4wtkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60af843351d74dd9b068b684da8584fc',uuid=698fc8bc-90d2-4b82-a7ae-6bcc20b253e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.070597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07db649a-2be5-51da-8b83-cadb0b4bc6b3', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:48.071982 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:48.077989 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.080033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.080033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1678249e-44, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:48.080447 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1678249e-44, col_values=(('qos', UUID('cab188d4-befe-4482-a857-b778c58523d4')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:48.082107 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1678249e-44, col_values=(('external_ids', {'iface-id': '1678249e-44d9-4d42-bea2-58e8e69636a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:34:41', 'vm-uuid': '698fc8bc-90d2-4b82-a7ae-6bcc20b253e5'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:48.084031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:48.091330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.092484 np0000001388 nova-compute[98319]: INFO os_vif [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44')
May 26 05:11:48.351344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.379925 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.472764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.554976 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-407b5dd3-3226-40ca-a309-32d5ed39046b req-9308c2a1-caf2-48f9-a41a-bd4144537c33 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:48.555174 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-407b5dd3-3226-40ca-a309-32d5ed39046b req-9308c2a1-caf2-48f9-a41a-bd4144537c33 service nova] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:48.555317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-407b5dd3-3226-40ca-a309-32d5ed39046b req-9308c2a1-caf2-48f9-a41a-bd4144537c33 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:48.555509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-407b5dd3-3226-40ca-a309-32d5ed39046b req-9308c2a1-caf2-48f9-a41a-bd4144537c33 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:48.555846 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-407b5dd3-3226-40ca-a309-32d5ed39046b req-9308c2a1-caf2-48f9-a41a-bd4144537c33 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Processing event network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:11:48.764417 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.769146 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.774302 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.794405 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.801080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:48.909433 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:48.909700 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:49.000647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-68e3306c-9a72-4977-aba9-be673f6b80b8 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.992s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:49.215124 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772309.2147553, c9d84182-2ad2-4572-b3f6-94312da22283 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:49.215664 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:11:49.215853 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] VM Started (Lifecycle Event)
May 26 05:11:49.218509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:11:49.221628 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance spawned successfully.
May 26 05:11:49.221893 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:11:49.347184 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:49.347402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:49.347666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:49.347873 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:49.348035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:49.349880 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Terminating instance
May 26 05:11:49.412300 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:49.608396 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:49.608552 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:49.608657 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No VIF found with MAC fa:16:3e:8d:34:41, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:49.609076 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Using config drive
May 26 05:11:49.718049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:49.722366 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:49.729446 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.729929 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.730536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.730881 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.731374 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.731849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:49.855065 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:11:49.877644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:49.880036 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:49.900996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:49.904355 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:49.918425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.421s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:49.918991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:11:49.935804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:49.939620 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.044120 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:50.044326 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:50.044559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:50.044759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:50.044934 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] No waiting events found dispatching network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:50.045097 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f0fe7ab4-44f0-45c3-81f3-3d82d380f0d2 req-7feb4a40-2940-412a-a956-e0cc1cbb2312 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:11:50.117239 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:50.182969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.197364 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.212060 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 18b8f158-289d-4829-b892-766548f70009] Instance destroyed successfully.
May 26 05:11:50.212812 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'resources' on Instance uuid 18b8f158-289d-4829-b892-766548f70009 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:50.224872 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:11:50.225382 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772310.2249706, c9d84182-2ad2-4572-b3f6-94312da22283 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:50.225579 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] VM Paused (Lifecycle Event)
May 26 05:11:50.238756 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Took 6.89 seconds to spawn the instance on the hypervisor.
May 26 05:11:50.238756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:50.285007 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Creating config drive at /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.config
May 26 05:11:50.290102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5vx0ag9 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:50.358978 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpo5vx0ag9" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:50.429723 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:11:50.430429 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:11:50.433144 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:50.433144 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:50.525847 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad7c375a52924ea48c19cb93653ea10e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8032d6bd9bb4c029e534ebae5756f21', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:11:50.641166 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:50.641481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:50.642065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:50.642211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:50.642392 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] No waiting events found dispatching network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:50.642549 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0b589e54-9ff9-433f-a353-a987b1ec45c4 req-da87e201-e745-4937-83dd-0542131f7db1 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received unexpected event network-vif-plugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 for instance with vm_state active and task_state None.
May 26 05:11:50.716478 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1035257622',display_name='tempest-AttachVolumeNegativeTest-server-1035257622',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-1035257622',id=51,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlQ7FKVPbUX7tILN00y99rOOTio2sn5q9jOoPGVrK4jCHmPhIBEKGiVvCxnsDhSqGC22+0yXWeG3yqsRLfaZH/nj4/hdWrAKLq2BAFT0sVyNfRHlGJUWqIh8IKt4aP8bg==',key_name='tempest-keypair-1320245493',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:56Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-rdfg616a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:10:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=18b8f158-289d-4829-b892-766548f70009,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:11:50.716795 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "33e6d629-7538-443f-bcee-d68cfb20c902", "address": "fa:16:3e:eb:57:04", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap33e6d629-75", "ovs_interfaceid": "33e6d629-7538-443f-bcee-d68cfb20c902", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:50.717645 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:50.717947 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:11:50.719316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.719712 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33e6d629-75, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:50.721941 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.723248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:50.727972 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:50.729074 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.730146 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.730348 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92672bad-36f9-4f54-a015-f4909e041380) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:50.731683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:50.735351 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772310.734881, c9d84182-2ad2-4572-b3f6-94312da22283 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:50.735846 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] VM Resumed (Lifecycle Event)
May 26 05:11:50.738614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.745221 np0000001388 nova-compute[98319]: INFO os_vif [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:57:04,bridge_name='br-int',has_traffic_filtering=True,id=33e6d629-7538-443f-bcee-d68cfb20c902,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33e6d629-75')
May 26 05:11:50.745221 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Deleting instance files /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009_del
May 26 05:11:50.745818 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Deletion of /opt/stack/data/nova/instances/18b8f158-289d-4829-b892-766548f70009_del complete
May 26 05:11:50.756582 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Took 12.39 seconds to build instance.
May 26 05:11:50.864292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.891880 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.894585 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:50.930749 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:11:51.024251 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:51.241066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:51.244029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:51.256550 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Took 1.40 seconds to destroy the instance on the hypervisor.
May 26 05:11:51.257944 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:11:51.258500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.903s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:51.258943 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 18b8f158-289d-4829-b892-766548f70009] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:11:51.259052 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 18b8f158-289d-4829-b892-766548f70009] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:11:51.259229 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:51.298861 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:51.305227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:51.307477 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:51.331779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:51.338177 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Successfully created port: 75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:11:51.354391 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:51.436241 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:11:51.749147 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999648732999958 future=<Future at 0x7d7ac43a3d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:51.750792 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998300440000094 future=<Future at 0x7d7ac43a3d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:51.750915 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99785011799986 future=<Future at 0x7d7ac43a3d10 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:11:51.902262 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772311.9018922, 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:51.902408 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] VM Started (Lifecycle Event)
May 26 05:11:52.024270 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Successfully updated port: 75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:11:52.078443 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-changed-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:52.078584 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing instance network info cache due to event network-changed-75359491-c5cc-4087-9220-25c664856eff. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:11:52.078956 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] Acquiring lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:52.079051 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] Acquired lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:52.079173 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing network info cache for port 75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:11:52.227036 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:52.227254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] Acquiring lock "18b8f158-289d-4829-b892-766548f70009-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:52.227390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:52.227513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] Lock "18b8f158-289d-4829-b892-766548f70009-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:52.227922 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] No waiting events found dispatching network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:52.228585 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38b486c1-6152-4c9b-9dc4-de5cb2a93763 req-d5e72958-2ffb-4706-b7f5-78cc6e3b85b4 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-unplugged-33e6d629-7538-443f-bcee-d68cfb20c902 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:11:52.383222 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 18b8f158-289d-4829-b892-766548f70009] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:52.409223 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:52.416720 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772312.416325, 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:52.416946 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] VM Paused (Lifecycle Event)
May 26 05:11:52.445519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:11:52.446495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:11:52.446829 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Creating image(s)
May 26 05:11:52.447232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:52.447734 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:52.448408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:52.448708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:52.449216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:52.511160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:52.525606 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:52.581159 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:52.673361 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:52.747148 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:52.752219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:52.752697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:52.752902 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:52.753087 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Processing event network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:11:52.753322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:52.753532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:52.753980 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:52.753980 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:52.754080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] No waiting events found dispatching network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:11:52.754215 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received unexpected event network-vif-plugged-1678249e-44d9-4d42-bea2-58e8e69636a7 for instance with vm_state building and task_state spawning.
May 26 05:11:52.754374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-978e630d-9d97-4e77-a998-004c9e377e23 req-9b3a7405-9415-4101-97b2-f26b124917f9 service nova] [instance: 18b8f158-289d-4829-b892-766548f70009] Received event network-vif-deleted-33e6d629-7538-443f-bcee-d68cfb20c902 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:52.756700 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:11:52.770790 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:11:52.774056 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance spawned successfully.
May 26 05:11:52.775227 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:11:52.882047 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:52.885658 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 18b8f158-289d-4829-b892-766548f70009] Took 1.63 seconds to deallocate network for instance.
May 26 05:11:52.920106 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:52.922607 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772312.9222834, 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:52.922902 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] VM Resumed (Lifecycle Event)
May 26 05:11:53.283713 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.283914 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.284376 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.284729 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.285101 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.285421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:53.364913 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.368468 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.368818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:53.387737 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-837eeda1-0965-4b48-b181-520896e6ed46 req-3b150377-82c8-4d0a-935a-9f7bfddb6d86 service nova] Releasing lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:53.388946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquired lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:53.389428 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:11:53.405786 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:53.406475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:53.434110 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:53.436082 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:53.478551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.part --force-share --output=json" returned: 0 in 0.110s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:53.479324 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] d795f44c-8ee3-47d7-b45c-498479cd230f was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:11:53.479897 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:11:53.480250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.part /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:53.673943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.part /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.converted" returned: 0 in 0.193s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:53.688367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:53.792104 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Took 8.09 seconds to spawn the instance on the hypervisor.
May 26 05:11:53.794683 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:53.801017 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7.converted --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:53.801680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.353s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:53.802183 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.813084 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.814276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:53.838893 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:11:53.839340 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:11:53.920802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:53.921215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:53.921701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:53.922213 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.925114 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:11:53.925401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:53.943344 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:11:54.005825 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:11:54.022631 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:54.023106 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7,backing_fmt=raw /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:54.088471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7,backing_fmt=raw /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk 1073741824" returned: 0 in 0.065s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:54.089100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "e17008de10ad68868ee76cdbbc7c23d043976bc7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:54.095522 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:54.199035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e17008de10ad68868ee76cdbbc7c23d043976bc7 --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:54.199762 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:11:54.200044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Ensure instance console log exists: /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:11:54.200387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:54.200685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:54.200876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:54.260140 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:54.318094 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Took 15.51 seconds to build instance.
May 26 05:11:54.325003 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-changed-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:54.325435 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Refreshing instance network info cache due to event network-changed-edd2a050-ed3e-4a7e-bba0-d389044b0211. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:11:54.325687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] Acquiring lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:54.325820 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] Acquired lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:54.325989 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Refreshing network info cache for port edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:11:54.346508 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:11:54.454224 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating instance_info_cache with network_info: [{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:54.830018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5327fa4-62a4-45b2-ad38-8ae6420c6cf7 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:54.830821 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:54.871426 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.465s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:54.943402 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Deleted allocations for instance 18b8f158-289d-4829-b892-766548f70009
May 26 05:11:54.955790 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Releasing lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:54.956122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance network_info: |[{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:11:54.960448 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Start _get_guest_xml network_info=[{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='f7d458688ff441e627c6a991ddf177dd',container_format='bare',created_at=2026-05-26T05:11:36Z,direct_url=<?>,disk_format='qcow2',id=d795f44c-8ee3-47d7-b45c-498479cd230f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-624834029',owner='e8032d6bd9bb4c029e534ebae5756f21',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-26T05:11:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'd795f44c-8ee3-47d7-b45c-498479cd230f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:11:54.967180 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:11:54.972441 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestStampPattern-server-41585982', uuid='11fb0123-705b-4023-877b-ae340fb616c2'), owner=OwnerMeta(userid='ad7c375a52924ea48c19cb93653ea10e', username='tempest-TestStampPattern-334045049-project-member', projectid='e8032d6bd9bb4c029e534ebae5756f21', projectname='tempest-TestStampPattern-334045049'), image=ImageMeta(id='d795f44c-8ee3-47d7-b45c-498479cd230f', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_owner_id': 'e8032d6bd9bb4c029e534ebae5756f21'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772314.9718604) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:11:54.975511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:11:54.975999 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:11:54.977283 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:11:54.977525 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:11:54.979592 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f7d458688ff441e627c6a991ddf177dd',container_format='bare',created_at=2026-05-26T05:11:36Z,direct_url=<?>,disk_format='qcow2',id=d795f44c-8ee3-47d7-b45c-498479cd230f,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-624834029',owner='e8032d6bd9bb4c029e534ebae5756f21',properties=ImageMetaProps,protected=<?>,size=53739520,status='active',tags=<?>,updated_at=2026-05-26T05:11:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:11:54.981225 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:11:54.981523 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:11:54.981775 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:11:54.981932 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:11:54.982070 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:11:54.982242 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:11:55.001395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-41585982',display_name='tempest-TestStampPattern-server-41585982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-41585982',id=55,image_ref='d795f44c-8ee3-47d7-b45c-498479cd230f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-whacbjjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3de26e-7807-4a99-943a-474537f0e547',image_min_disk='1',image_min_ram='0',image_owner_id='e8032d6bd9bb4c029e534ebae5756f21',image_owner_project_name='tempest-TestStampPattern-334045049',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-334045049-project-member',image_user_id='ad7c375a52924ea48c19cb93653ea10e',network_allocated='True',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:51Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=11fb0123-705b-4023-877b-ae340fb616c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:11:55.001395 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:55.002163 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:55.003847 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'pci_devices' on Instance uuid 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:11:55.214863 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:55.240299 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-changed-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:55.240299 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Refreshing instance network info cache due to event network-changed-1678249e-44d9-4d42-bea2-58e8e69636a7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:11:55.240299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] Acquiring lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:11:55.240299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] Acquired lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:11:55.240299 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Refreshing network info cache for port 1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:11:55.340022 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updated VIF entry in instance network info cache for port edd2a050-ed3e-4a7e-bba0-d389044b0211. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:11:55.340324 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating instance_info_cache with network_info: [{"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:55.505853 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] End _get_guest_xml xml=<domain type="qemu">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <uuid>11fb0123-705b-4023-877b-ae340fb616c2</uuid>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <name>instance-00000037</name>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestStampPattern-server-41585982</nova:name>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:11:54</nova:creationTime>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:property name="img_owner_id">e8032d6bd9bb4c029e534ebae5756f21</nova:property>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:user uuid="ad7c375a52924ea48c19cb93653ea10e">tempest-TestStampPattern-334045049-project-member</nova:user>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:project uuid="e8032d6bd9bb4c029e534ebae5756f21">tempest-TestStampPattern-334045049</nova:project>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         <nova:port uuid="75359491-c5cc-4087-9220-25c664856eff">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <system>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="serial">11fb0123-705b-4023-877b-ae340fb616c2</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="uuid">11fb0123-705b-4023-877b-ae340fb616c2</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </system>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <os>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </os>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <features>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </features>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   <devices>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.config"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </disk>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:2d:ae:59"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <target dev="tap75359491-c5"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </interface>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/console.log" append="off"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </serial>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <video>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </video>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </rng>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:   </devices>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]: </domain>
May 26 05:11:55.505853 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Preparing to wait for external event network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-41585982',display_name='tempest-TestStampPattern-server-41585982',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-41585982',id=55,image_ref='d795f44c-8ee3-47d7-b45c-498479cd230f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-whacbjjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3de26e-7807-4a99-943a-474537f0e547',image_min_disk='1',image_min_ram='0',image_owner_id='e8032d6bd9bb4c029e534ebae5756f21',image_owner_project_name='tempest-TestStampPattern-334045049',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-334045049-project-member',image_user_id='ad7c375a52924ea48c19cb93653ea10e',network_allocated='True',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:11:51Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=11fb0123-705b-4023-877b-ae340fb616c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:11:55.508292 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:11:55.508595 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:55.509157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:55.509237 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:11:55.509996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:55.510209 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5360bfdf-2696-5fe8-b495-b47d908bfdf2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:55.512124 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:55.512755 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:55.515081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:55.515373 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75359491-c5, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:55.515923 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75359491-c5, col_values=(('qos', UUID('61c58501-823b-4a21-aebf-6f9ac0a33a21')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:55.516153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75359491-c5, col_values=(('external_ids', {'iface-id': '75359491-c5cc-4087-9220-25c664856eff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:ae:59', 'vm-uuid': '11fb0123-705b-4023-877b-ae340fb616c2'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:11:55.518738 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:11:55.523400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:55.524422 np0000001388 nova-compute[98319]: INFO os_vif [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5')
May 26 05:11:55.742301 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:55.842357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2ca3111-1757-4357-91dc-b447b815f525 req-9be87868-9005-4160-a8ec-dcf7f0f04ac4 service nova] Releasing lock "refresh_cache-c9d84182-2ad2-4572-b3f6-94312da22283" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:55.952973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0f81b1f7-3144-4d18-9205-a57258ccd99d tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "18b8f158-289d-4829-b892-766548f70009" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.606s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:56.082810 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:56.237389 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updated VIF entry in instance network info cache for port 1678249e-44d9-4d42-bea2-58e8e69636a7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:11:56.237710 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating instance_info_cache with network_info: [{"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:11:56.512862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:56.739850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f830710b-d837-48f8-ae30-e48e1bb90252 req-b551c08a-25c1-460b-80df-f11d9aa69b12 service nova] Releasing lock "refresh_cache-698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:11:57.050020 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:57.050020 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:11:57.050020 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No VIF found with MAC fa:16:3e:2d:ae:59, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:11:57.050020 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Using config drive
May 26 05:11:57.518705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:57.555536 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:11:57.693091 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Creating config drive at /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.config
May 26 05:11:57.697862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjj_z3qca {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:11:57.756782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpjj_z3qca" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:11:58.245037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.270526 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.273508 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.382879 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.464377 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.465354 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:11:58.529737 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-421d9b84-23e0-4adc-9b6b-344e9c056b85 req-060871b3-df34-45fd-b7a8-d557f22825c4 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:11:58.529930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-421d9b84-23e0-4adc-9b6b-344e9c056b85 req-060871b3-df34-45fd-b7a8-d557f22825c4 service nova] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:58.530159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-421d9b84-23e0-4adc-9b6b-344e9c056b85 req-060871b3-df34-45fd-b7a8-d557f22825c4 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:58.530372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-421d9b84-23e0-4adc-9b6b-344e9c056b85 req-060871b3-df34-45fd-b7a8-d557f22825c4 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:11:58.531251 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-421d9b84-23e0-4adc-9b6b-344e9c056b85 req-060871b3-df34-45fd-b7a8-d557f22825c4 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Processing event network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:11:59.178399 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772319.1778765, 11fb0123-705b-4023-877b-ae340fb616c2 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:11:59.179121 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:11:59.179422 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] VM Started (Lifecycle Event)
May 26 05:11:59.182216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:11:59.185564 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance spawned successfully.
May 26 05:11:59.185733 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:11:59.188461 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:59.188863 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:11:59.301534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:11:59.302002 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:11:59.682730 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:59.684927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:11:59.695119 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Took 7.25 seconds to spawn the instance on the hypervisor.
May 26 05:11:59.695293 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:11:59.803676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:12:00.189312 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:12:00.189312 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772320.1876104, 11fb0123-705b-4023-877b-ae340fb616c2 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:00.189312 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] VM Paused (Lifecycle Event)
May 26 05:12:00.207988 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Took 12.75 seconds to build instance.
May 26 05:12:00.361823 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:00.362247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:00.366110 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:12:00.366298 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Claim successful on node np0000001388
May 26 05:12:00.519170 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:00.606147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:00.606340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:00.606500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:00.606660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:00.606785 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] No waiting events found dispatching network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:00.607035 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d113222d-c5f0-4a4f-ae28-8ad89f2e33f5 req-6f8b3865-c1f9-472e-b487-11e6eb65d77e service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received unexpected event network-vif-plugged-75359491-c5cc-4087-9220-25c664856eff for instance with vm_state active and task_state None.
May 26 05:12:00.691355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:00.694413 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772320.692823, 11fb0123-705b-4023-877b-ae340fb616c2 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:00.694413 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] VM Resumed (Lifecycle Event)
May 26 05:12:00.709508 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.262s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:01.196991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:01.198717 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:12:01.776945 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:01.777628 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:02.280800 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:02.491446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-changed-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:02.491647 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing instance network info cache due to event network-changed-75359491-c5cc-4087-9220-25c664856eff. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:12:02.491884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] Acquiring lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:02.492037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] Acquired lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:02.492208 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing network info cache for port 75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:12:02.521479 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:02.789247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.427s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:02.789683 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:12:02.995535 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:03.296070 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:12:03.296282 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:12:03.296537 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:03.296856 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:03.356896 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:03.395100 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a5137ef274a4a94a48962027c45d899', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23047976f3814538912524932a6a9375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:12:03.549178 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updated VIF entry in instance network info cache for port 75359491-c5cc-4087-9220-25c664856eff. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:12:03.550348 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating instance_info_cache with network_info: [{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:03.799567 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:12:03.933711 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Successfully created port: 304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:12:04.052068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ce6439bd-49c7-4f6b-8f62-aa2de05ce08a req-3621471b-2910-48cf-a39a-8e2494501e98 service nova] Releasing lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:04.305563 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:12:04.462096 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Successfully updated port: 304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:12:04.566090 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-changed-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:04.566601 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Refreshing instance network info cache due to event network-changed-304220cc-5dca-4fe1-b744-898d915c2cf1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:12:04.566915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] Acquiring lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:04.567049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] Acquired lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:04.567189 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Refreshing network info cache for port 304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:12:04.964747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:05.069278 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:05.139697 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:12:05.296029 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Creating image(s)
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:05.315225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:05.316311 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:12:05.319953 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:12:05.321313 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:05.432902 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:05.433676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:05.434391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:05.435122 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:12:05.439664 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:12:05.440167 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:05.521751 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:05.529096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:05.532307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:05.607408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk 1073741824" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:05.610964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:05.610964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:05.695145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:05.695905 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:12:05.696289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:05.800050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ff9897b6-8fd9-4f20-b93b-2e02d13c6f8d req-04dd0194-991c-40b6-a657-bcc1993012a3 service nova] Releasing lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:05.800490 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquired lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:05.800763 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:12:05.815847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Cannot resize image /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Ensure instance console log exists: /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:05.818374 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:06.390554 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:12:06.543248 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:06.671934 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating instance_info_cache with network_info: [{"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:06.749183 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000393038999845885 future=<Future at 0x7d7ac43a3d10 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:06.749354 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:06.749650 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772311.748671, 18b8f158-289d-4829-b892-766548f70009 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:06.749815 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] VM Stopped (Lifecycle Event)
May 26 05:12:07.173949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Releasing lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:07.174433 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance network_info: |[{"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:12:07.176575 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Start _get_guest_xml network_info=[{"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:12:07.181428 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:12:07.183532 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeNegativeTest-server-728134266', uuid='9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf'), owner=OwnerMeta(userid='3a5137ef274a4a94a48962027c45d899', username='tempest-AttachVolumeNegativeTest-1739279332-project-member', projectid='23047976f3814538912524932a6a9375', projectname='tempest-AttachVolumeNegativeTest-1739279332'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772327.1828282) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:12:07.184685 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:12:07.185119 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:12:07.189215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:12:07.201155 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-728134266',display_name='tempest-AttachVolumeNegativeTest-server-728134266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-728134266',id=56,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb8ea1DZUFczZzDktC+PkxaSZoAtVZYlwXrHRK6zbi4mLQUp3ZIU57CC9nJIIc1k0D7dcF6HVfFWXRKE/M75YUwYHEOne70aBTEObtZkjZVpKNqngljMfe6mRAbbyTrNg==',key_name='tempest-keypair-161733652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-zc8xi9o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:12:07.201567 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:07.202619 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:07.203359 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'pci_devices' on Instance uuid 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:07.252491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 18b8f158-289d-4829-b892-766548f70009] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:07.522505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.706103 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] End _get_guest_xml xml=<domain type="qemu">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <uuid>9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf</uuid>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <name>instance-00000038</name>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeNegativeTest-server-728134266</nova:name>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:12:07</nova:creationTime>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:user uuid="3a5137ef274a4a94a48962027c45d899">tempest-AttachVolumeNegativeTest-1739279332-project-member</nova:user>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:project uuid="23047976f3814538912524932a6a9375">tempest-AttachVolumeNegativeTest-1739279332</nova:project>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         <nova:port uuid="304220cc-5dca-4fe1-b744-898d915c2cf1">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <system>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="serial">9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="uuid">9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </system>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <os>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </os>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <features>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </features>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   <devices>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </disk>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.config"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </disk>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:23:c7:65"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <target dev="tap304220cc-5d"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </interface>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/console.log" append="off"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </serial>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <video>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </video>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </rng>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:   </devices>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]: </domain>
May 26 05:12:07.706103 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Preparing to wait for external event network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-728134266',display_name='tempest-AttachVolumeNegativeTest-server-728134266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-728134266',id=56,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb8ea1DZUFczZzDktC+PkxaSZoAtVZYlwXrHRK6zbi4mLQUp3ZIU57CC9nJIIc1k0D7dcF6HVfFWXRKE/M75YUwYHEOne70aBTEObtZkjZVpKNqngljMfe6mRAbbyTrNg==',key_name='tempest-keypair-161733652',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-zc8xi9o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:12:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:07.711321 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:12:07.711969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.711969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:07.712607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:12:07.712706 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.712960 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5023689-100c-5d43-a315-bfaab171e9b5', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:07.721772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.722824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.723139 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:07.723588 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.725700 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.725864 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap304220cc-5d, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:07.726229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap304220cc-5d, col_values=(('qos', UUID('cffc3dd8-fc00-4232-8456-16c83933c510')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:07.726759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap304220cc-5d, col_values=(('external_ids', {'iface-id': '304220cc-5dca-4fe1-b744-898d915c2cf1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:c7:65', 'vm-uuid': '9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:07.727903 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.728952 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:07.734923 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:07.736493 np0000001388 nova-compute[98319]: INFO os_vif [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d')
May 26 05:12:09.255626 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:09.260683 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:09.260683 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:23:c7:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:09.260683 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Using config drive
May 26 05:12:09.768643 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:09.890643 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Creating config drive at /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.config
May 26 05:12:09.897420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1se30muq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:09.959573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp1se30muq" returned: 0 in 0.064s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:10.346817 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.372826 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.378837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.469912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.536965 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1123c03-16f7-46b8-8296-69045e46e305 req-97589841-dab8-47ed-8529-7ab4a80b5bb3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:10.537554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1123c03-16f7-46b8-8296-69045e46e305 req-97589841-dab8-47ed-8529-7ab4a80b5bb3 service nova] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:10.537692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1123c03-16f7-46b8-8296-69045e46e305 req-97589841-dab8-47ed-8529-7ab4a80b5bb3 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:10.537900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d1123c03-16f7-46b8-8296-69045e46e305 req-97589841-dab8-47ed-8529-7ab4a80b5bb3 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:10.538112 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d1123c03-16f7-46b8-8296-69045e46e305 req-97589841-dab8-47ed-8529-7ab4a80b5bb3 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Processing event network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:12:10.714375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.718741 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:10.740307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:11.165360 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772331.164948, 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:11.165529 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] VM Started (Lifecycle Event)
May 26 05:12:11.167237 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:12:11.169541 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:12:11.173217 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance spawned successfully.
May 26 05:12:11.173530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:12:11.672030 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:11.673814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:12:11.679922 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:11.680074 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:11.680500 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:11.680750 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:11.681095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:11.681474 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:12:12.178184 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:12:12.178184 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772332.1782591, 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:12.178716 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] VM Paused (Lifecycle Event)
May 26 05:12:12.186923 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Took 6.87 seconds to spawn the instance on the hypervisor.
May 26 05:12:12.187171 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:12.525621 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:12.594337 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:12.595041 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:12.595324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:12.595583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:12.596018 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] No waiting events found dispatching network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:12.596018 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-005ec644-9969-4642-9c0b-61b7c4fb13fa req-665895b6-9afc-4fb4-a073-962b7236ce06 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received unexpected event network-vif-plugged-304220cc-5dca-4fe1-b744-898d915c2cf1 for instance with vm_state active and task_state None.
May 26 05:12:12.681308 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:12.683137 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772332.682927, 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:12.683283 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] VM Resumed (Lifecycle Event)
May 26 05:12:12.696694 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Took 12.39 seconds to build instance.
May 26 05:12:12.728909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:13.185486 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:13.187270 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:12:13.198363 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dc0f9814-abce-4da5-b73a-ff05d1af1220 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.896s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:13.713452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-changed-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:13.713929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Refreshing instance network info cache due to event network-changed-304220cc-5dca-4fe1-b744-898d915c2cf1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:12:13.714133 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] Acquiring lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:13.714259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] Acquired lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:13.714392 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Refreshing network info cache for port 304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:12:14.217225 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:14.539340 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:14.688745 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updated VIF entry in instance network info cache for port 304220cc-5dca-4fe1-b744-898d915c2cf1. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:12:14.688977 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating instance_info_cache with network_info: [{"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:15.191037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-afe629dc-729b-4d8c-97f9-6a2db0a6e986 req-73406e18-b612-4ce9-87e0-24df65000d75 service nova] Releasing lock "refresh_cache-9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:15.242121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:15.242314 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:15.745171 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Detaching volume 304812a7-5e07-438a-a652-1a4c1e12b90e
May 26 05:12:15.798296 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Attempting to driver detach volume 304812a7-5e07-438a-a652-1a4c1e12b90e from mountpoint /dev/vdb
May 26 05:12:15.803553 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdb by alias ua-304812a7-5e07-438a-a652-1a4c1e12b90e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:15.805062 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdb by alias ua-304812a7-5e07-438a-a652-1a4c1e12b90e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:15.805120 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Attempting to detach device vdb from instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:12:15.805503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <alias name="ua-304812a7-5e07-438a-a652-1a4c1e12b90e"/>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <serial>304812a7-5e07-438a-a652-1a4c1e12b90e</serial>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:15.805503 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:15.816001 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdb from instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 from the persistent domain config.
May 26 05:12:15.816166 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] (1/8): Attempting to detach device vdb with device alias ua-304812a7-5e07-438a-a652-1a4c1e12b90e from instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:12:15.816460 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <alias name="ua-304812a7-5e07-438a-a652-1a4c1e12b90e"/>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-2"/>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <serial>304812a7-5e07-438a-a652-1a4c1e12b90e</serial>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:15.816460 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:16.339762 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772336.3393087, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => ua-304812a7-5e07-438a-a652-1a4c1e12b90e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:12:16.340690 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-304812a7-5e07-438a-a652-1a4c1e12b90e for instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:12:16.343139 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdb from instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 from the live domain config.
May 26 05:12:16.344326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:12:16.344699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:16.344886 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:16.345312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:16.345685 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '304812a7-5e07-438a-a652-1a4c1e12b90e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:12:16.345866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:12:16.373439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:12:16.373439 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:12:16.373439 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:16.373699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [139] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:12:16.373699 np0000001388 nova-compute[98319]: tcp: [140] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e (non-flash)
May 26 05:12:16.373699 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:16.373699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '139'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '140')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:12:16.373879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '139')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:16.374763 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e', '140')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:16.375510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46eae80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:12:16.375753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:12:16.376077 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flush multipath device 3300000008f7ce9f2 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:12:16.408656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:16.447980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:16.494519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:12:16.494698 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:12:16.495400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:12:16.508594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:12:16.508842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:12:16.523068 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.549314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 139, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260]
May 26 05:12:16.549314 np0000001388 nova-compute[98319]: Logout of [sid: 139, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.40.100,3260] successful.
May 26 05:12:16.549314 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.561669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.575672 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.599400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 140, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260]
May 26 05:12:16.599400 np0000001388 nova-compute[98319]: Logout of [sid: 140, target: iqn.2023-03.storpool.com:os--volume-304812a7-5e07-438a-a652-1a4c1e12b90e, portal: 192.168.50.100,3260] successful.
May 26 05:12:16.599400 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.611976 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:16.612307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:16.612452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== disconnect_volume: return (267ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:16.612528 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:12:17.158265 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:17.525622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:17.729229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:18.164817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9523a391-ef44-444d-a002-abe231864290 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.922s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:18.429962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:18.430112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:18.430247 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:18.432285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 26 05:12:18.432704 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:19.456856 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.463532 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.482966 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.508828 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.622098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:19.622272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:19.622435 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:19.622576 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:19.622718 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:19.622896 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-1b861bbd-be77-4a73-a34e-6774f3bab26b req-06e4eaf2-394d-4613-8b8f-a421fcc026c2 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state active and task_state powering-off.
May 26 05:12:19.750445 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.759467 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:19.775512 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999571138000192 future=<Future at 0x7d7aa44eb1d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:19.775912 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999157173000185 future=<Future at 0x7d7aa44eb1d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:19.776057 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998969472000226 future=<Future at 0x7d7aa44eb1d0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:19.777102 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance destroyed successfully.
May 26 05:12:19.777504 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'numa_topology' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:20.279445 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:20.279615 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:20.785567 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-086bfc37-4ab7-4a20-b75e-1d5810cf1afd tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.355s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:21.211016 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:21.702147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:21.702605 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:21.702788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:21.702955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:21.703106 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:21.703274 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-03f27443-d78e-411d-bf15-dee125ae3610 req-60dd012b-91b5-407f-8bd2-fc68e295fa0c service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state stopped and task_state powering-on.
May 26 05:12:21.715375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:21.715592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquired lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:21.715592 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:12:21.715702 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'info_cache' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:22.218441 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:22.542330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:22.720782 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:22.732739 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:23.024289 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:23.168802 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:23.671067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Releasing lock "refresh_cache-fc92f62b-3d3a-4e8b-a981-8a57840fb928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:24.685616 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance destroyed successfully.
May 26 05:12:24.686374 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'numa_topology' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:25.188393 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:25.188677 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'resources' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:25.690704 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:25.691773 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:12:25.692076 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:25.692906 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:25.693250 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:12:25.694623 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:25.694834 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfdef0e4-27, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:25.697694 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:25.698286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:25.699301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:25.699489 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e797843-89b7-4811-adb4-1eb26e25c25a) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:25.700779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:25.703704 np0000001388 nova-compute[98319]: INFO os_vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:12:25.708376 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start _get_guest_xml network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:12:25.710641 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:12:25.711736 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-800092940', uuid='fc92f62b-3d3a-4e8b-a981-8a57840fb928'), owner=OwnerMeta(userid='6abb55160a21467e8a9137d4790b90ad', username='tempest-AttachVolumeTestJSON-1676547055-project-member', projectid='2efc51fa90bd472aa54bd9d44b862522', projectname='tempest-AttachVolumeTestJSON-1676547055'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772345.711396) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:12:25.712884 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:12:25.713265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:12:25.714220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:12:25.714408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:12:25.715210 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:12:25.715515 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:12:25.715638 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:12:25.715774 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:12:25.715872 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:12:25.716004 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:12:25.716107 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:12:25.716318 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:12:25.716453 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:12:25.716586 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:12:25.716714 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:12:25.716881 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:12:25.717036 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'vcpu_model' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:26.219220 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:26.230645 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:12:26.230946 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:26.231438 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:26.231973 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'pci_devices' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:26.734049 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:26.735239 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] End _get_guest_xml xml=<domain type="qemu">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <uuid>fc92f62b-3d3a-4e8b-a981-8a57840fb928</uuid>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <name>instance-00000031</name>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-800092940</nova:name>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:12:25</nova:creationTime>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:user uuid="6abb55160a21467e8a9137d4790b90ad">tempest-AttachVolumeTestJSON-1676547055-project-member</nova:user>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:project uuid="2efc51fa90bd472aa54bd9d44b862522">tempest-AttachVolumeTestJSON-1676547055</nova:project>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         <nova:port uuid="bfdef0e4-27d9-4463-86ac-f670c1ec4b71">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <system>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="serial">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="uuid">fc92f62b-3d3a-4e8b-a981-8a57840fb928</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </system>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <os>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </os>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <features>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </features>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   <devices>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </disk>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk.config"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </disk>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:ed:b3:54"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <target dev="tapbfdef0e4-27"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </interface>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/console.log" append="off"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </serial>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <video>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </video>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </rng>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:   </devices>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]: </domain>
May 26 05:12:26.735239 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:12:26.740165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:26.833910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:26.834536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:26.926160 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:26.927249 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'trusted_certs' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:27.430032 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:27.430389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:27.527503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:27.528068 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:12:27.528400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:27.560041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:27.615646 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:27.616009 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Cannot resize image /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:12:27.616342 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'migration_context' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:28.119124 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Object Instance<fc92f62b-3d3a-4e8b-a981-8a57840fb928> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:12:28.120427 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:12:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:12:28.120700 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:28.121652 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:28.122009 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:12:28.122352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.122631 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:28.122981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:12:28.123764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.123952 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b00f62d6-44a2-5004-b87c-0cb22ff45837', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:28.126129 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:28.127898 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.128069 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfdef0e4-27, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:28.128334 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfdef0e4-27, col_values=(('qos', UUID('32b99281-b8b1-4b44-bdbe-9580eeabd479')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:28.128485 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfdef0e4-27, col_values=(('external_ids', {'iface-id': 'bfdef0e4-27d9-4463-86ac-f670c1ec4b71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:b3:54', 'vm-uuid': 'fc92f62b-3d3a-4e8b-a981-8a57840fb928'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:28.130433 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:28.135312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.136142 np0000001388 nova-compute[98319]: INFO os_vif [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:12:28.599450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.623865 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.731105 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:28.839163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:28.839163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:28.839365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:28.839493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:28.839896 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:28.839896 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-7a8a2716-81e9-41c7-915e-214e384ea5c9 req-c062afeb-7dc0-4d49-904b-58e52dd5ddec service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state stopped and task_state powering-on.
May 26 05:12:29.027511 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:29.030945 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:29.034745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:29.036596 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:29.056722 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:29.289702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:29.290183 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:29.516602 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for fc92f62b-3d3a-4e8b-a981-8a57840fb928 due to new event <LifecycleEvent: 1779772349.5161228, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:12:29.516846 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772349.5161228, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:29.517058 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Resumed (Lifecycle Event)
May 26 05:12:29.520053 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:12:29.524107 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance rebooted successfully.
May 26 05:12:29.617732 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:29.618754 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:29.619301 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:12:29.793839 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:30.019440 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:30.021299 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:12:30.523521 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:12:30.524057 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772350.5235293, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:30.524057 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Started (Lifecycle Event)
May 26 05:12:30.618603 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:30.619180 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:30.619639 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:12:30.798603 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:30.894371 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-5444da1b-54ba-4513-89c5-14e2d3c256a5 req-e2236c45-a0fc-46c7-a0be-0aa0c7946fc0 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received unexpected event network-vif-plugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with vm_state stopped and task_state powering-on.
May 26 05:12:31.026217 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:31.028221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:12:31.037995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:31.037995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:31.037995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:ed:b3:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:31.037995 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-86603c7a-7c6a-4580-a436-541d94754b67 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:12:31.531364 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:12:31.673693 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:31.674217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:31.877570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:31.877721 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:31.877905 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Attaching volume 0d2dc34a-8529-4d5d-9e41-57d031274426 to /dev/vdb
May 26 05:12:31.918864 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:31.930206 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:12:31.952618 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:31.998103 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:12:31.998494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:12:32.009455 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:12:32.010844 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:fe15:de36', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fe8d:3441', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe2d:ae59', 'fe80::fc16:3eff:fe23:c765', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:12:32.011032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:12:32.011213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:12:32.011513 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:32.011809 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating existing volume attachment record: 7e88901a-a56f-4ba2-9acb-a7e191def413 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:12:32.178168 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'flavor' on Instance uuid 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:32.502053 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:32.503346 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:12:32.562546 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:32.596071 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c9d84182-2ad2-4572-b3f6-94312da22283', 'attached_at': '', 'detached_at': '', 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'serial': '0d2dc34a-8529-4d5d-9e41-57d031274426'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:12:32.599232 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:12:32.599675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:32.599978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:32.600609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:32.600894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:12:32.613142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:32.613647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:32.614069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:32.614342 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:32.614599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:32.614801 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:32.618085 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:32.625849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:32.625849 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:32.630127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:32.630127 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:32.639205 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426] added
May 26 05:12:32.639205 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:32.639205 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:32.639205 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:32.639205 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:32.639205 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:32.639205 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:32.639490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:32.639591 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:32.639754 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:32.642001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426] added
May 26 05:12:32.642001 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:32.642001 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:32.642001 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:32.642001 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:32.642001 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:32.642001 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:32.642210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:32.642358 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:32.642489 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:33.122929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:33.122929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:33.122929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:33.122929 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:12:33.144365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:33.183758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:33.640343 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:33.643525 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:33.652508 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:33.652508 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:33.658867 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:33.658867 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:33.664513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:33.671858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:33.676594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:33.676594 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:33.676722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:33.676722 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:33.676852 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:12:33.676852 np0000001388 nova-compute[98319]: 
May 26 05:12:33.685270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:33.685270 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:33.685380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:33.685380 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:33.685496 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:12:33.685496 np0000001388 nova-compute[98319]: 
May 26 05:12:34.151290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.245949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.249217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.259839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:34.260497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:34.260926 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Attaching volume 8182c2c7-64eb-4226-9d9a-e9db156d2d9e to /dev/vdb
May 26 05:12:34.306666 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:34.321058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:12:34.347534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.359416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.368225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.391840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:12:34.392399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:12:34.404175 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:12:34.406973 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:fe15:de36', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fe8d:3441', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe2d:ae59', 'fe80::fc16:3eff:fe23:c765', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:12:34.407341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:12:34.407592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:12:34.407838 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:34.408097 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating existing volume attachment record: 5f4cb9e4-5108-483e-92e2-bd1a6440ab09 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:12:34.459875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.463526 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.546479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.552216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.638940 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.642217 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.716840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.40.100,3260]
May 26 05:12:34.716840 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.40.100,3260] successful.
May 26 05:12:34.716840 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:34.718646 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.50.100,3260]
May 26 05:12:34.718646 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.50.100,3260] successful.
May 26 05:12:34.718646 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:34.729879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:34.730777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.734860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.735245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:34.751261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.751261 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.751261 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:34.752338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.752338 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.752338 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:34.752549 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.752549 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.752549 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:34.753395 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.139s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:34.753643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.753643 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:34.753643 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:34.754013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:34.754436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.139s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:34.754541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:34.755180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('7', '-', '-', 0) found on session 143 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:34.755353 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:34.756144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('8', '-', '-', 0) found on session 144 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:34.756303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0008011569998416235 future=<Future at 0x7d7aa44eb1d0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 143 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 144 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:34.787012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:34.844166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.847277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.958400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:34.971293 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:34.992310 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '698fc8bc-90d2-4b82-a7ae-6bcc20b253e5', 'attached_at': '', 'detached_at': '', 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'serial': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:12:34.998825 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:12:34.999416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:34.999689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:35.060121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:35.064227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:35.148434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:35.154271 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:35.244701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:35.248214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:35.333652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:35.338547 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:12:35.341259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:35.395724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.055s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:12:35.396495 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12434MB free_disk=72.64704513549805GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:12:35.396965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:35.397443 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:35.615042 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:12:36.478504 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance fc92f62b-3d3a-4e8b-a981-8a57840fb928 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.478912 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 7c3de26e-7807-4a99-943a-474537f0e547 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.478912 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c9d84182-2ad2-4572-b3f6-94312da22283 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.478912 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.479047 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 11fb0123-705b-4023-877b-ae340fb616c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.479127 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:12:36.479563 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:12:36.479768 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:12:35 up 44 min,  2 users,  load average: 5.32, 5.85, 4.70\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '6', 'num_proj_2efc51fa90bd472aa54bd9d44b862522': '1', 'io_workload': '0', 'num_proj_e8032d6bd9bb4c029e534ebae5756f21': '2', 'num_proj_495b51ea0c0f4e2f996fbd7a5ccdf223': '1', 'num_proj_71aa9e17bf6d4b99856c025e45c86c48': '1', 'num_proj_23047976f3814538912524932a6a9375': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:12:36.633819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found WWN 3300000002013ad78 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:12:36.634257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:36.635351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.635s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:36.635920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '3300000002013ad78', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002013ad78'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:36.636290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:12:36.636609 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000002013ad78', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000002013ad78'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:12:36.639931 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:12:36.640188 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:36.642844 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:36.643827 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7d7aa437d520>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'c9d84182-2ad2-4572-b3f6-94312da22283', 'attached_at': '', 'detached_at': '', 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'serial': '0d2dc34a-8529-4d5d-9e41-57d031274426'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:12:36.644096 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.cryptsetup [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecated: The plain CryptsetupEncryptor is deprecated and will be removed in a future release. Existing users are encouraged to retype any existing volumes using this encryptor to the 'luks' LuksEncryptor or 'luks2' Luks2Encryptor encryptors as soon as possible.
May 26 05:12:36.644319 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 26 05:12:36.644424 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.cryptsetup [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] opening encrypted volume /dev/dm-0 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:104}}
May 26 05:12:36.653105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:36.653840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:36.654274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:36.655179 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:36.655386 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:36.655675 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:36.671616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:36.671616 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:36.677901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:36.677901 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:36.687096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e] added
May 26 05:12:36.687096 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:36.687096 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:36.687096 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:36.687096 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:36.687096 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:36.687096 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:36.687485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:36.687542 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:36.687686 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e] added
May 26 05:12:36.694240 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:36.694240 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:36.694240 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:36.694601 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.039(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:36.694649 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:36.772022 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:36.862402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:36.862641 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:37.275540 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Attempting to attach volume 0d2dc34a-8529-4d5d-9e41-57d031274426 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:12:37.277099 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:   <alias name="ua-0d2dc34a-8529-4d5d-9e41-57d031274426"/>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:   <serial>0d2dc34a-8529-4d5d-9e41-57d031274426</serial>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:37.277099 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:12:37.365783 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:37.571085 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:37.688229 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:37.695152 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:37.701822 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:37.701822 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:37.712430 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:37.712430 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.719220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.728355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.736622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.736622 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.736622 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:37.736859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.736859 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.736859 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:37.745549 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.745549 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.745549 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:37.745726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.745726 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.745726 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:37.779066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.40.100,3260]
May 26 05:12:37.779066 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.40.100,3260] successful.
May 26 05:12:37.779066 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.784376 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.50.100,3260]
May 26 05:12:37.784376 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.50.100,3260] successful.
May 26 05:12:37.784376 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.792165 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.798184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:37.807403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.807403 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.807403 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.807403 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.807403 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:37.807657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.807657 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.807657 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.807657 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.807657 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:37.807915 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:37.808065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:37.808789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('9', '-', '-', 0) found on session 145 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:37.808919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:37.819127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.819127 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.819127 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.819127 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.819127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:37.819596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.819596 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:37.819596 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.819596 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:37.819596 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:37.819596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:37.819908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:37.820290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('10', '-', '-', 0) found on session 146 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:37.820426 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:37.827226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:37.838958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 146 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:37.838958 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:37.873807 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:12:37.874076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.477s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:37.874624 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:12:38.145975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:38.824155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 145 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:38.824656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:38.874672 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:38.875215 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:12:38.875215 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:12:38.878254 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.74 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:12:38.926566 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:38.926724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:38.926872 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:38.927037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:15:de:36, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:38.993131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:38.993324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:39.496604 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:39.672589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Found WWN 330000000ca98cb6a for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:12:39.672763 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:39.673717 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== connect_volume: return (4674ms) {'type': 'block', 'scsi_wwn': '330000000ca98cb6a', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000ca98cb6a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:39.673836 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ca98cb6a', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '330000000ca98cb6a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:12:39.675233 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:12:39.675351 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:39.675490 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:39.688146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:12:39.688146 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:12:39.688146 np0000001388 nova-compute[98319]:     <volume>8182c2c7-64eb-4226-9d9a-e9db156d2d9e</volume>
May 26 05:12:39.688146 np0000001388 nova-compute[98319]:   </usage>
May 26 05:12:39.688146 np0000001388 nova-compute[98319]: </secret>
May 26 05:12:39.688146 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:12:39.692683 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'flavor' on Instance uuid 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:40.195261 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Attempting to attach volume 8182c2c7-64eb-4226-9d9a-e9db156d2d9e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:12:40.196396 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <alias name="ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e"/>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <serial>8182c2c7-64eb-4226-9d9a-e9db156d2d9e</serial>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="a1628c0b-bdae-47aa-ac44-e585a44c26a6"/>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:40.196396 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:12:40.472062 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d81eef85-c244-40b5-82b0-18bc828b73ab tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.594s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:40.501460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:40.766800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:40.766800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:41.270230 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Detaching volume 0d2dc34a-8529-4d5d-9e41-57d031274426
May 26 05:12:41.315221 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Attempting to driver detach volume 0d2dc34a-8529-4d5d-9e41-57d031274426 from mountpoint /dev/vdb
May 26 05:12:41.355963 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'plain'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'c9d84182-2ad2-4572-b3f6-94312da22283', 'attached_at': '', 'detached_at': '', 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'serial': '0d2dc34a-8529-4d5d-9e41-57d031274426'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:12:41.359066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-0d2dc34a-8529-4d5d-9e41-57d031274426 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:41.359992 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-0d2dc34a-8529-4d5d-9e41-57d031274426 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:41.360124 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Attempting to detach device vdb from instance c9d84182-2ad2-4572-b3f6-94312da22283 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:12:41.360346 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <alias name="ua-0d2dc34a-8529-4d5d-9e41-57d031274426"/>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <serial>0d2dc34a-8529-4d5d-9e41-57d031274426</serial>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:41.360346 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:41.365266 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance c9d84182-2ad2-4572-b3f6-94312da22283 from the persistent domain config.
May 26 05:12:41.365458 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] (1/8): Attempting to detach device vdb with device alias ua-0d2dc34a-8529-4d5d-9e41-57d031274426 from instance c9d84182-2ad2-4572-b3f6-94312da22283 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:12:41.365700 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <alias name="ua-0d2dc34a-8529-4d5d-9e41-57d031274426"/>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <serial>0d2dc34a-8529-4d5d-9e41-57d031274426</serial>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:41.365700 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:41.599405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:41.599569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:41.599879 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Attaching volume 8b8c437c-6a48-4313-b969-2841d9550203 to /dev/vdb
May 26 05:12:41.642810 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:41.655217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:12:41.677989 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:41.722649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:12:41.723047 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:12:41.733337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:12:41.734817 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:fe15:de36', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fe8d:3441', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe2d:ae59', 'fe80::fc16:3eff:fe23:c765', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:12:41.734931 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:12:41.735043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:12:41.735283 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:41.735540 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating existing volume attachment record: 47ca2b3f-e2c8-4599-8a7f-8ea75f4800d9 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:12:41.877550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772361.8770921, c9d84182-2ad2-4572-b3f6-94312da22283 => ua-0d2dc34a-8529-4d5d-9e41-57d031274426> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:12:41.878161 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0d2dc34a-8529-4d5d-9e41-57d031274426 for instance c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:12:41.880973 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance c9d84182-2ad2-4572-b3f6-94312da22283 from the live domain config.
May 26 05:12:41.882390 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:12:41.882632 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:41.882777 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:12:41.883430 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryptor '<os_brick.encryptors.cryptsetup.CryptsetupEncryptor object at 0x7d7aa4297d10>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': 'c9d84182-2ad2-4572-b3f6-94312da22283', 'attached_at': '', 'detached_at': '', 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'serial': '0d2dc34a-8529-4d5d-9e41-57d031274426'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:12:41.883567 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.cryptsetup [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] closing encrypted volume /dev/dm-1 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/cryptsetup.py:153}}
May 26 05:12:41.904391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:12:41.904742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:41.904924 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:41.905428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:41.905762 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0d2dc34a-8529-4d5d-9e41-57d031274426', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:12:41.905888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:12:41.930589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:41.930589 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:41.930589 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:41.930589 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:41.930589 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [143] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: tcp: [144] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426 (non-flash)
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:41.930994 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', '143'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', '144'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '146')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:12:41.930994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', '143')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:41.931977 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426', '144')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:41.932797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac412afc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:12:41.933015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:12:41.933339 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flush multipath device 3300000002013ad78 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:12:41.960640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:42.009654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:42.077425 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:12:42.077592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:12:42.078419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:12:42.089477 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:12:42.089624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:12:42.100280 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.127756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 143, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.40.100,3260]
May 26 05:12:42.127756 np0000001388 nova-compute[98319]: Logout of [sid: 143, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.40.100,3260] successful.
May 26 05:12:42.127756 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.140451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.151504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.188368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 144, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.50.100,3260]
May 26 05:12:42.188368 np0000001388 nova-compute[98319]: Logout of [sid: 144, target: iqn.2023-03.storpool.com:os--volume-0d2dc34a-8529-4d5d-9e41-57d031274426, portal: 192.168.50.100,3260] successful.
May 26 05:12:42.188368 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.201405 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.203153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:42.203299 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== disconnect_volume: return (298ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:42.203541 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:12:42.287134 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:12:42.287531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:42.287531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:42.287797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:42.287953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:12:42.301047 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:42.302059 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:42.302399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:42.302592 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:42.303128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:42.303291 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:42.313173 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:42.313173 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.318127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:42.318127 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.323587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203] added
May 26 05:12:42.323587 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:42.323587 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:42.323587 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:42.323587 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:42.323587 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:42.323587 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.323807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:42.324481 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:42.324738 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:42.328435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203] added
May 26 05:12:42.328435 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:42.328435 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:42.328435 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:42.328435 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:42.328435 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:42.328435 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:42.328656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:42.328656 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:42.328784 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:42.580662 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:42.750900 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:42.799565 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:42.799722 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:42.799722 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:42.799832 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No VIF found with MAC fa:16:3e:8d:34:41, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:43.148029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:43.324979 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:43.329291 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:43.337769 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:43.337769 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:43.340105 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:43.340105 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.350802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.352175 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.364541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.364541 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.364541 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:43.364898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.364898 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.364898 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:43.369330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.369330 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.369330 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:43.369430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.369430 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.369430 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:43.398075 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.40.100,3260]
May 26 05:12:43.398075 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.40.100,3260] successful.
May 26 05:12:43.398075 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.411276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.425990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.425990 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.425990 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.425990 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.425990 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:43.426478 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.50.100,3260]
May 26 05:12:43.426478 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.50.100,3260] successful.
May 26 05:12:43.426478 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.426705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.426705 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.426705 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.426705 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.426705 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:43.427306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:43.427306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:43.427860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] HCTL ('7', '-', '-', 0) found on session 147 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:43.427964 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:43.439288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:43.447148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching for a device in session 147 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:43.447148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:43.456278 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] HCTL ('8', '-', '-', 0) found on session 148 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:43.456278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:43.470340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Searching for a device in session 148 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:43.470340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:43.756695 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1423cc03-6df4-47ed-8dad-dcf73851a704 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.991s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:44.114037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:44.114385 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:44.114440 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:44.114550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:44.114654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:44.116790 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Terminating instance
May 26 05:12:44.303101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:12:44.350792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-18e1e622-a5fa-48b9-8998-fa7cb6b7d19d tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.090s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:44.620092 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:12:44.638884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:44.665345 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:44.672404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:44.698631 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:44.825263 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:44.825450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:44.825654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:44.825696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:44.825812 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] No waiting events found dispatching network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:44.825925 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b19ee1b8-d7d0-4fe0-945b-5591979c544b req-2c658ba5-3d4c-4258-86cd-1206e96ce9f0 service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:44.954071 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999635186999967 future=<Future at 0x7d7aa4348620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:44.954516 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99917049700025 future=<Future at 0x7d7aa4348620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:44.954668 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998971244000131 future=<Future at 0x7d7aa4348620 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:44.958840 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Instance destroyed successfully.
May 26 05:12:44.959440 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'resources' on Instance uuid c9d84182-2ad2-4572-b3f6-94312da22283 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:45.229807 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:45.229961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:45.317488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found WWN 33000000006050e75 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:12:45.317716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:45.317863 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000006050e75', 'path': '/dev/dm-0', 'multipath_id': '33000000006050e75'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:45.317990 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000006050e75', 'path': '/dev/dm-0', 'multipath_id': '33000000006050e75'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:12:45.319986 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:45.461861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:11:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1632108657',display_name='tempest-TestEncryptedCinderVolumes-server-1632108657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1632108657',id=53,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWMoKtKTSC++YDNdQ3lR7ngUZBlaToG0Tq29ELa8ZPrZeLBY/r8dEObAF/8eymHzJCNWQ+Qr/55G1oEl0KMWlzixaSOR45bfmfg1nbezHe1UZZf3/YIZb8I8vRdBdcMDw==',key_name='tempest-keypair-388808548',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:11:50Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-9jvemevy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9d84182-2ad2-4572-b3f6-94312da22283,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:12:45.462422 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "address": "fa:16:3e:15:de:36", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapedd2a050-ed", "ovs_interfaceid": "edd2a050-ed3e-4a7e-bba0-d389044b0211", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:45.462614 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:45.462897 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:12:45.464299 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:45.464673 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedd2a050-ed, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:45.467063 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:45.467948 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:45.468235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3f49199-d939-4d7f-9d4a-c27bbbbde454) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:45.468823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:45.469469 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:45.469680 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:45.471520 np0000001388 nova-compute[98319]: INFO os_vif [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:de:36,bridge_name='br-int',has_traffic_filtering=True,id=edd2a050-ed3e-4a7e-bba0-d389044b0211,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedd2a050-ed')
May 26 05:12:45.471844 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Deleting instance files /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283_del
May 26 05:12:45.472558 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Deletion of /opt/stack/data/nova/instances/c9d84182-2ad2-4572-b3f6-94312da22283_del complete
May 26 05:12:45.732132 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Detaching volume 8182c2c7-64eb-4226-9d9a-e9db156d2d9e
May 26 05:12:45.769898 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Attempting to driver detach volume 8182c2c7-64eb-4226-9d9a-e9db156d2d9e from mountpoint /dev/vdb
May 26 05:12:45.795053 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': '698fc8bc-90d2-4b82-a7ae-6bcc20b253e5', 'attached_at': '', 'detached_at': '', 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'serial': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:12:45.797955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Found disk vdb by alias ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:45.799019 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Found disk vdb by alias ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:45.799148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Attempting to detach device vdb from instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:12:45.799407 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <alias name="ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <serial>8182c2c7-64eb-4226-9d9a-e9db156d2d9e</serial>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="a1628c0b-bdae-47aa-ac44-e585a44c26a6"/>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:45.799407 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:45.804130 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully detached device vdb from instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 from the persistent domain config.
May 26 05:12:45.804324 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] (1/8): Attempting to detach device vdb with device alias ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e from instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:12:45.804538 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <alias name="ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <serial>8182c2c7-64eb-4226-9d9a-e9db156d2d9e</serial>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="a1628c0b-bdae-47aa-ac44-e585a44c26a6"/>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:45.804538 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:45.822606 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Attempting to attach volume 8b8c437c-6a48-4313-b969-2841d9550203 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:12:45.824685 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:   <alias name="ua-8b8c437c-6a48-4313-b969-2841d9550203"/>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:   <serial>8b8c437c-6a48-4313-b969-2841d9550203</serial>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:45.824685 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:12:45.978023 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Took 1.36 seconds to destroy the instance on the hypervisor.
May 26 05:12:45.979354 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:12:45.979719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:12:45.979862 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:12:45.980452 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:46.074849 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:46.291487 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772366.2910817, 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 => ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:12:46.291845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8182c2c7-64eb-4226-9d9a-e9db156d2d9e for instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:12:46.293707 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully detached device vdb from instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 from the live domain config.
May 26 05:12:46.295482 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:12:46.295730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:46.295834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:46.296163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:46.296437 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:12:46.296537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:12:46.322463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:46.322463 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:46.322463 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:46.322463 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:46.322463 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:46.322712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [145] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:46.322712 np0000001388 nova-compute[98319]: tcp: [146] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e (non-flash)
May 26 05:12:46.322712 np0000001388 nova-compute[98319]: tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:46.322712 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:46.322712 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:46.322712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '145'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '146'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '148')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:12:46.322893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '145')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:46.323612 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e', '146')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:46.324266 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43614e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:12:46.324482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:12:46.324662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flush multipath device 330000000ca98cb6a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:12:46.360025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:46.403716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:46.435150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:46.440849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:12:46.441006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:12:46.441846 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:12:46.453747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:12:46.453953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:12:46.464622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.492872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 145, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.40.100,3260]
May 26 05:12:46.492872 np0000001388 nova-compute[98319]: Logout of [sid: 145, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.40.100,3260] successful.
May 26 05:12:46.492872 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.505408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.515913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.517526 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-625c1587-af68-41d1-a5e5-0867176f3454 req-b0be82a7-146c-4861-8aab-9af041e3091c service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-deleted-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:46.518110 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-625c1587-af68-41d1-a5e5-0867176f3454 req-b0be82a7-146c-4861-8aab-9af041e3091c service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Neutron deleted interface edd2a050-ed3e-4a7e-bba0-d389044b0211; detaching it from the instance and deleting it from the info cache
May 26 05:12:46.518382 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-625c1587-af68-41d1-a5e5-0867176f3454 req-b0be82a7-146c-4861-8aab-9af041e3091c service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:46.543110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 146, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.50.100,3260]
May 26 05:12:46.543110 np0000001388 nova-compute[98319]: Logout of [sid: 146, target: iqn.2023-03.storpool.com:os--volume-8182c2c7-64eb-4226-9d9a-e9db156d2d9e, portal: 192.168.50.100,3260] successful.
May 26 05:12:46.543110 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.554117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:46.555545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:46.555741 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== disconnect_volume: return (260ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:46.555930 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:12:46.891410 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:46.891543 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] Acquiring lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:46.891762 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:46.891928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] Lock "c9d84182-2ad2-4572-b3f6-94312da22283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:46.892148 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] No waiting events found dispatching network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:46.892322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-73521cdb-a7f0-4a38-877b-5c6ecb9f6a32 req-047891e0-be0d-4cb7-a03d-e69e3d53a19e service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Received event network-vif-unplugged-edd2a050-ed3e-4a7e-bba0-d389044b0211 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:46.966014 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:47.021698 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-625c1587-af68-41d1-a5e5-0867176f3454 req-b0be82a7-146c-4861-8aab-9af041e3091c service nova] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Detach interface failed, port_id=edd2a050-ed3e-4a7e-bba0-d389044b0211, reason: Instance c9d84182-2ad2-4572-b3f6-94312da22283 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:12:47.098611 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'flavor' on Instance uuid 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:47.468740 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Took 1.49 seconds to deallocate network for instance.
May 26 05:12:47.473977 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:47.474154 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:47.474323 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:47.474481 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] No VIF found with MAC fa:16:3e:2d:ae:59, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:47.581911 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:47.975136 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:47.975674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:48.103756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4fa13eee-602b-4e48-8b3c-85d3c5239bb5 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.874s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:48.255037 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:48.255273 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:48.512549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:48.513176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:48.513176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:48.513339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:48.513413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:48.516000 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Terminating instance
May 26 05:12:48.757828 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:49.021973 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:12:49.022339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-75deadab-2ec3-4d5e-8788-c7dc532154d0 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.423s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:49.038705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.054375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.057684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.073572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.078824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.157336 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:49.157713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:49.157713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:49.157857 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:49.157994 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] No waiting events found dispatching network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:49.158538 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-83b66e25-ac57-4a72-b4e6-5281ca3eafa8 req-83ab75ec-29e1-407a-a507-1490a361d55e service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:49.264459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.289s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:49.314940 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deleted allocations for instance c9d84182-2ad2-4572-b3f6-94312da22283
May 26 05:12:49.342817 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999754250000024 future=<Future at 0x7d7aa43b7950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:49.347223 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Instance destroyed successfully.
May 26 05:12:49.347223 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'resources' on Instance uuid 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:49.847780 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:11:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-2042341956',display_name='tempest-TestEncryptedCinderVolumes-server-2042341956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-2042341956',id=54,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBW6dVJIUO6pdKslXrj2Y1vOjdqPaA7Bss7zzYK7FdUvg8dmtbzVMHHiLfKjUUXgu9E3oi65x42Bq749xHQvSs4hxGGquIogCK33vGFgJFAJDa8vMQaa2bTuQlZ0B3h2aA==',key_name='tempest-keypair-1677756276',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:11:53Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-djb4wtkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='60af843351d74dd9b068b684da8584fc',uuid=698fc8bc-90d2-4b82-a7ae-6bcc20b253e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:12:49.848215 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "1678249e-44d9-4d42-bea2-58e8e69636a7", "address": "fa:16:3e:8d:34:41", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap1678249e-44", "ovs_interfaceid": "1678249e-44d9-4d42-bea2-58e8e69636a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:49.848592 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:49.848801 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:12:49.849718 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.849973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1678249e-44, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:49.851018 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.851862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:49.852027 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.852808 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.853496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cab188d4-befe-4482-a857-b778c58523d4) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:49.854449 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:49.854628 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:49.856631 np0000001388 nova-compute[98319]: INFO os_vif [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:34:41,bridge_name='br-int',has_traffic_filtering=True,id=1678249e-44d9-4d42-bea2-58e8e69636a7,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1678249e-44')
May 26 05:12:49.856883 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Deleting instance files /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5_del
May 26 05:12:49.857860 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Deletion of /opt/stack/data/nova/instances/698fc8bc-90d2-4b82-a7ae-6bcc20b253e5_del complete
May 26 05:12:50.322858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c7eaa17d-635b-4636-bb1a-cbd264c1fde9 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9d84182-2ad2-4572-b3f6-94312da22283" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.209s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:50.363602 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Took 1.34 seconds to destroy the instance on the hypervisor.
May 26 05:12:50.364073 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:12:50.364269 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:12:50.364341 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:12:50.364531 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:50.422541 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:50.908868 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0795642-7e7d-490a-a062-e1761aef1a13 req-360830f4-275e-4cb7-a53c-94a78c14e5d8 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-deleted-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:50.909319 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-a0795642-7e7d-490a-a062-e1761aef1a13 req-360830f4-275e-4cb7-a53c-94a78c14e5d8 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Neutron deleted interface 1678249e-44d9-4d42-bea2-58e8e69636a7; detaching it from the instance and deleting it from the info cache
May 26 05:12:50.909428 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a0795642-7e7d-490a-a062-e1761aef1a13 req-360830f4-275e-4cb7-a53c-94a78c14e5d8 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:51.127270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:51.128608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:51.216174 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:51.216392 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] Acquiring lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:51.216577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:51.216700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:51.216831 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] No waiting events found dispatching network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:51.217103 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5cb8aa33-8fa2-4084-841b-2cd21e90f6b7 req-0f97a42d-b151-4341-8a96-863f0d7b8538 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Received event network-vif-unplugged-1678249e-44d9-4d42-bea2-58e8e69636a7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:51.358375 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:51.412767 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a0795642-7e7d-490a-a062-e1761aef1a13 req-360830f4-275e-4cb7-a53c-94a78c14e5d8 service nova] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Detach interface failed, port_id=1678249e-44d9-4d42-bea2-58e8e69636a7, reason: Instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:12:51.630581 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:51.860460 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Took 1.50 seconds to deallocate network for instance.
May 26 05:12:51.895751 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:51.895934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:52.366421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:52.366847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:52.398357 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Detaching volume 8b8c437c-6a48-4313-b969-2841d9550203
May 26 05:12:52.446772 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Attempting to driver detach volume 8b8c437c-6a48-4313-b969-2841d9550203 from mountpoint /dev/vdb
May 26 05:12:52.452491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found disk vdb by alias ua-8b8c437c-6a48-4313-b969-2841d9550203 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:52.456753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Found disk vdb by alias ua-8b8c437c-6a48-4313-b969-2841d9550203 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:12:52.456952 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Attempting to detach device vdb from instance 11fb0123-705b-4023-877b-ae340fb616c2 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:12:52.457334 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <alias name="ua-8b8c437c-6a48-4313-b969-2841d9550203"/>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <serial>8b8c437c-6a48-4313-b969-2841d9550203</serial>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:52.457334 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:52.468361 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully detached device vdb from instance 11fb0123-705b-4023-877b-ae340fb616c2 from the persistent domain config.
May 26 05:12:52.468560 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] (1/8): Attempting to detach device vdb with device alias ua-8b8c437c-6a48-4313-b969-2841d9550203 from instance 11fb0123-705b-4023-877b-ae340fb616c2 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:12:52.468746 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <alias name="ua-8b8c437c-6a48-4313-b969-2841d9550203"/>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <serial>8b8c437c-6a48-4313-b969-2841d9550203</serial>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:52.468746 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:12:52.583644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:52.636110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:52.705402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:52.705722 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:53.064237 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772373.0638468, 11fb0123-705b-4023-877b-ae340fb616c2 => ua-8b8c437c-6a48-4313-b969-2841d9550203> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:12:53.064671 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8b8c437c-6a48-4313-b969-2841d9550203 for instance 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:12:53.068476 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully detached device vdb from instance 11fb0123-705b-4023-877b-ae340fb616c2 from the live domain config.
May 26 05:12:53.070773 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:12:53.071084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:53.071243 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:53.071621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:53.071927 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8b8c437c-6a48-4313-b969-2841d9550203', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:12:53.072071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:12:53.100620 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:53.100620 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:53.100620 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:53.100843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsi session list stdout=tcp: [147] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:53.100843 np0000001388 nova-compute[98319]: tcp: [148] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203 (non-flash)
May 26 05:12:53.100843 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:53.100934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '147'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '148')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:12:53.101003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '147')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:53.101969 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203', '148')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:12:53.102718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac44200e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:12:53.102908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:12:53.103156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Flush multipath device 33000000006050e75 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:12:53.136360 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:53.198843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:12:53.209090 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:53.257039 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:12:53.257304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:12:53.257978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:12:53.271599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:12:53.271749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:12:53.285056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.323112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 147, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.40.100,3260]
May 26 05:12:53.323112 np0000001388 nova-compute[98319]: Logout of [sid: 147, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.40.100,3260] successful.
May 26 05:12:53.323112 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.334969 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.347035 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.378456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 148, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.50.100,3260]
May 26 05:12:53.378456 np0000001388 nova-compute[98319]: Logout of [sid: 148, target: iqn.2023-03.storpool.com:os--volume-8b8c437c-6a48-4313-b969-2841d9550203, portal: 192.168.50.100,3260] successful.
May 26 05:12:53.378456 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.391098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:53.391393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:53.391550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] <== disconnect_volume: return (319ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:53.391712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:12:53.720003 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.352s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:53.723539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:53.723834 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:53.724109 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Attaching volume 395907b1-78ee-44ee-80fe-f9c47bb04a3d to /dev/vdb
May 26 05:12:53.766645 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:53.777783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:12:53.787982 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deleted allocations for instance 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5
May 26 05:12:53.797863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:12:53.838668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:12:53.838937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:12:53.848504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:12:53.849550 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fee2:9744', 'fe80::7452:2cff:fe07:1788', 'fe80::fc16:3eff:fe2d:ae59', 'fe80::fc16:3eff:fe23:c765', 'fe80::5877:a6ff:fe1f:de24', 'fe80::fc16:3eff:feed:b354', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:12:53.849662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:12:53.849761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:12:53.849978 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:53.850253 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating existing volume attachment record: 4b0616ce-5dc3-4ffe-a7f6-d56dd82b5ee0 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:12:53.958208 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'flavor' on Instance uuid 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:54.410126 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:12:54.412276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:12:54.412276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:54.412276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:54.412276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:12:54.427030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:54.427686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:12:54.428090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:54.428365 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:54.428683 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:12:54.428865 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:54.444400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:54.444400 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:54.445619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:12:54.445619 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:54.459950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d] added
May 26 05:12:54.459950 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:54.459950 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:54.459950 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:54.459950 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:54.459950 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:54.459950 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:54.460301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:54.460337 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0313(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:54.460598 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:54.465496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d] added
May 26 05:12:54.465496 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:12:54.465496 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:54.465496 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:54.465496 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:12:54.465496 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:12:54.465496 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:54.465713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:12:54.465981 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0376(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:12:54.466191 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:12:54.796899 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b0cb7910-9e9d-4789-94bc-13858b467cbd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "698fc8bc-90d2-4b82-a7ae-6bcc20b253e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.284s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:54.813332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:54.813609 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:54.813725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:54.813833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:54.813939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:54.817324 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Terminating instance
May 26 05:12:54.854850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:54.890123 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-changed-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:54.890346 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing instance network info cache due to event network-changed-75359491-c5cc-4087-9220-25c664856eff. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:12:54.890694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] Acquiring lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:12:54.890694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] Acquired lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:12:54.891375 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Refreshing network info cache for port 75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:12:54.901606 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:54.902407 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:54.967036 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1a9334e-15c6-4e20-b84a-d70be2e3760c tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.071s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:55.320387 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:12:55.336414 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.339383 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.353749 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.355921 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.380130 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.393753 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:55.404255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:12:55.420161 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:55.420649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:55.420649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:55.420906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:55.420906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:55.424860 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Terminating instance
May 26 05:12:55.461444 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:12:55.467085 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:55.476378 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:55.476378 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:12:55.483543 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:12:55.483543 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.488630 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.496411 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.502283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:55.502283 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:55.502283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:55.502283 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:55.502283 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:12:55.502283 np0000001388 nova-compute[98319]: 
May 26 05:12:55.508208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:55.508208 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:55.508477 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:12:55.508477 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:55.508477 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:12:55.508477 np0000001388 nova-compute[98319]: 
May 26 05:12:55.524487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.50.100,3260]
May 26 05:12:55.524487 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.50.100,3260] successful.
May 26 05:12:55.524487 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.536496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.547553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.40.100,3260]
May 26 05:12:55.547553 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.40.100,3260] successful.
May 26 05:12:55.547553 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.559410 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.559410 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:55.559410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:55.559953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('7', '-', '-', 0) found on session 149 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:55.560054 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:55.565895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:12:55.577129 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 149 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:55.577502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:55.583127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.583127 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.583127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:12:55.583127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.583127 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:12:55.583127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:12:55.583607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:55.583844 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:12:55.584347 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] HCTL ('8', '-', '-', 0) found on session 150 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:12:55.584491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:12:55.602792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Searching for a device in session 150 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:12:55.602792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:12:55.656465 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999622153000018 future=<Future at 0x7d7aa43a32c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:55.658083 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Instance destroyed successfully.
May 26 05:12:55.658616 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'resources' on Instance uuid fc92f62b-3d3a-4e8b-a981-8a57840fb928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:55.793358 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:55.917021 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updated VIF entry in instance network info cache for port 75359491-c5cc-4087-9220-25c664856eff. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:12:55.917315 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating instance_info_cache with network_info: [{"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:55.928021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:12:55.947746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.950668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.966176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:55.969722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:55.969849 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:55.973327 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:12:55.973491 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Claim successful on node np0000001388
May 26 05:12:56.081610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:56.082671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:56.082775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:56.083389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:56.083389 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] No waiting events found dispatching network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:56.083389 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e6310b86-05b5-4f4a-bd35-2ff33c249b93 req-9abc8271-47b4-4e35-a942-492f401e1ef2 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:56.115938 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.126825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.161031 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-800092940',display_name='tempest-AttachVolumeTestJSON-server-800092940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-800092940',id=49,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGubAglb6Divs0MOqzu/0Mcv2+cY0kuepZGYwx63Xia4pAbo0aYZAbGyD4761gBCe8U4Djvw6Pxj8Kh7eQJsjKpdxBeA9cTID1R43fEODvX+ofTABYv/zEaOWB1nKLSOuw==',key_name='tempest-keypair-641342836',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:26Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-r1840sg8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:12:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=fc92f62b-3d3a-4e8b-a981-8a57840fb928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:12:56.161276 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "address": "fa:16:3e:ed:b3:54", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfdef0e4-27", "ovs_interfaceid": "bfdef0e4-27d9-4463-86ac-f670c1ec4b71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:56.162058 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:56.162058 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:12:56.165150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.165150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfdef0e4-27, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:56.166414 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:56.172287 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.173344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.173591 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=32b99281-b8b1-4b44-bdbe-9580eeabd479) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:56.174381 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.175053 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:56.180452 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.182498 np0000001388 nova-compute[98319]: INFO os_vif [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:b3:54,bridge_name='br-int',has_traffic_filtering=True,id=bfdef0e4-27d9-4463-86ac-f670c1ec4b71,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfdef0e4-27')
May 26 05:12:56.182924 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Deleting instance files /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928_del
May 26 05:12:56.183779 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Deletion of /opt/stack/data/nova/instances/fc92f62b-3d3a-4e8b-a981-8a57840fb928_del complete
May 26 05:12:56.246275 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999770450000142 future=<Future at 0x7d7ac43caf00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:56.247718 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Instance destroyed successfully.
May 26 05:12:56.247984 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'resources' on Instance uuid 11fb0123-705b-4023-877b-ae340fb616c2 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:56.418980 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0a7f5e2-e937-4005-8cac-587ed1d2964a req-a52dbe4d-8b5a-45cf-8be0-3032af991c47 service nova] Releasing lock "refresh_cache-11fb0123-705b-4023-877b-ae340fb616c2" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:12:56.428580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:12:56.689284 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:12:56.689739 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:12:56.690126 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:12:56.690259 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:12:56.690492 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:56.750398 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:11:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-41585982',display_name='tempest-TestStampPattern-server-41585982',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-41585982',id=55,image_ref='d795f44c-8ee3-47d7-b45c-498479cd230f',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:11:59Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-whacbjjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='7c3de26e-7807-4a99-943a-474537f0e547',image_min_disk='1',image_min_ram='0',image_owner_id='e8032d6bd9bb4c029e534ebae5756f21',image_owner_project_name='tempest-TestStampPattern-334045049',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-334045049-project-member',image_user_id='ad7c375a52924ea48c19cb93653ea10e',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:12:00Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=11fb0123-705b-4023-877b-ae340fb616c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:12:56.750650 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "75359491-c5cc-4087-9220-25c664856eff", "address": "fa:16:3e:2d:ae:59", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap75359491-c5", "ovs_interfaceid": "75359491-c5cc-4087-9220-25c664856eff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:12:56.751080 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:12:56.751337 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:12:56.752215 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.752398 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75359491-c5, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:56.753393 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.754289 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:56.754487 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.755121 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.755278 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61c58501-823b-4a21-aebf-6f9ac0a33a21) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:12:56.755964 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.756234 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:12:56.756516 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:56.758269 np0000001388 nova-compute[98319]: INFO os_vif [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:ae:59,bridge_name='br-int',has_traffic_filtering=True,id=75359491-c5cc-4087-9220-25c664856eff,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75359491-c5')
May 26 05:12:56.758497 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Deleting instance files /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2_del
May 26 05:12:56.759071 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Deletion of /opt/stack/data/nova/instances/11fb0123-705b-4023-877b-ae340fb616c2_del complete
May 26 05:12:56.799562 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:56.954668 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:56.954833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:56.954980 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:56.955076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:56.955207 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:56.955321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:56.955450 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:56.955513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Acquiring lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:56.955628 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:56.955714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:56.956064 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] No waiting events found dispatching network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:56.956171 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-51297cef-fe5c-4573-9483-0c71df06331b req-467b33ae-20d6-4038-807f-9fbdd96ff430 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-unplugged-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:57.234767 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:57.235007 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:57.264007 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Took 1.34 seconds to destroy the instance on the hypervisor.
May 26 05:12:57.264377 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:12:57.264583 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:12:57.264672 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:12:57.264876 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:57.316456 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:57.443159 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found WWN 330000000a537c62c for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:12:57.443592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:12:57.443592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000a537c62c', 'path': '/dev/dm-0', 'multipath_id': '330000000a537c62c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:12:57.443674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a537c62c', 'path': '/dev/dm-0', 'multipath_id': '330000000a537c62c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:12:57.445866 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:12:57.585083 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:12:57.636146 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:57.737669 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:57.948402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Attempting to attach volume 395907b1-78ee-44ee-80fe-f9c47bb04a3d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:12:57.949761 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:   <alias name="ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d"/>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:   <serial>395907b1-78ee-44ee-80fe-f9c47bb04a3d</serial>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]: </disk>
May 26 05:12:57.949761 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:12:58.024027 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:12:58.138723 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Took 1.45 seconds to deallocate network for instance.
May 26 05:12:58.155707 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:58.155918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] Acquiring lock "11fb0123-705b-4023-877b-ae340fb616c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:58.156251 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:58.156329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] Lock "11fb0123-705b-4023-877b-ae340fb616c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:58.156470 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] No waiting events found dispatching network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:12:58.156625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-unplugged-75359491-c5cc-4087-9220-25c664856eff for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:12:58.157306 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee8bcc7d-e5f7-4558-a19f-f0bfd891b4a1 req-9ec6a3cf-0e7b-4e84-96ab-5107029f4b18 service nova] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Received event network-vif-deleted-75359491-c5cc-4087-9220-25c664856eff {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:58.243851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.274s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:58.244371 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:12:58.525907 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Took 1.26 seconds to deallocate network for instance.
May 26 05:12:58.645211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:58.645211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:58.749794 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:12:58.750552 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:12:58.750806 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:58.751020 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:12:58.853722 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f737dd526dff4402bb2deb8e2fe56f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495b51ea0c0f4e2f996fbd7a5ccdf223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:12:58.917463 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:12:58.917463 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:12:59.011927 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-12ccc9fa-882a-4cb5-b847-ff64cd253442 req-b47b8ff6-171a-4900-8320-a57b060e5f42 service nova] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Received event network-vif-deleted-bfdef0e4-27d9-4463-86ac-f670c1ec4b71 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:12:59.031189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:12:59.253418 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:12:59.359879 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Successfully created port: 9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:12:59.419727 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:12:59.592640 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:59.593016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:59.593016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:12:59.593016 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] No VIF found with MAC fa:16:3e:23:c7:65, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:12:59.756472 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:12:59.825776 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Successfully updated port: 9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:12:59.925506 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.281s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:12:59.926354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.894s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:12:59.954067 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003403330001674476 future=<Future at 0x7d7aa4348620 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:59.954067 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:59.954149 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.388372923000134 future=<Future at 0x7d7aa43b7950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:59.954259 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.388279609000165 future=<Future at 0x7d7aa43b7950 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:12:59.954755 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Emitting event <LifecycleEvent: 1779772364.9535635, c9d84182-2ad2-4572-b3f6-94312da22283 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:12:59.955008 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] VM Stopped (Lifecycle Event)
May 26 05:12:59.982151 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Deleted allocations for instance fc92f62b-3d3a-4e8b-a981-8a57840fb928
May 26 05:13:00.175251 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:00.175441 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:00.214758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-changed-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:00.215072 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Refreshing instance network info cache due to event network-changed-9b1bd52b-419a-4a32-896f-c68274cb3be2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:00.215238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] Acquiring lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:00.215357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] Acquired lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:00.215447 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Refreshing network info cache for port 9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:00.328059 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:00.457528 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: c9d84182-2ad2-4572-b3f6-94312da22283] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:00.677668 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:00.717640 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:00.765137 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:13:00.766393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:13:00.766765 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Creating image(s)
May 26 05:13:00.767409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:00.767689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:00.768365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:00.769228 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:00.771899 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:00.773076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:00.790973 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:00.860621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.088s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:00.861067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:00.861538 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:00.861980 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:00.864707 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:00.865050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:00.970640 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:00.971868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:00.972367 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:00.995166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e6a2dd66-4649-4ec0-a0ab-e9de1af549ea tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "fc92f62b-3d3a-4e8b-a981-8a57840fb928" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:01.029808 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk 1073741824" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:01.030305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:01.030680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:01.124805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:01.125735 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:13:01.125735 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:01.148802 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-fb0e4d2a-c0bd-4224-a27e-5859359ac9a4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.424s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:01.183819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.258s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:01.210412 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:01.211267 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Cannot resize image /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:13:01.211267 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:13:01.211397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Ensure instance console log exists: /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:13:01.211621 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:01.211815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:01.211931 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:01.229550 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Deleted allocations for instance 11fb0123-705b-4023-877b-ae340fb616c2
May 26 05:13:01.483927 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-7cda4828-9899-4e7c-a49d-a0b6c2ca155b req-7eaec2cf-f083-4a09-bd56-b9089392a031 service nova] Releasing lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:01.484619 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquired lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:01.484876 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:13:01.627221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:01.627221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:01.756058 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:02.049745 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:02.130178 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Detaching volume 395907b1-78ee-44ee-80fe-f9c47bb04a3d
May 26 05:13:02.176470 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Attempting to driver detach volume 395907b1-78ee-44ee-80fe-f9c47bb04a3d from mountpoint /dev/vdb
May 26 05:13:02.181959 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:13:02.183149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Found disk vdb by alias ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:13:02.183352 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Attempting to detach device vdb from instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:13:02.183744 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <alias name="ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d"/>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <serial>395907b1-78ee-44ee-80fe-f9c47bb04a3d</serial>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]: </disk>
May 26 05:13:02.183744 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:13:02.189389 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf from the persistent domain config.
May 26 05:13:02.189584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] (1/8): Attempting to detach device vdb with device alias ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d from instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:13:02.189861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <alias name="ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d"/>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <serial>395907b1-78ee-44ee-80fe-f9c47bb04a3d</serial>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]: </disk>
May 26 05:13:02.189861 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:13:02.205744 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:02.237422 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7d2107cc-9f21-4850-a2ce-bc8bb211d579 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "11fb0123-705b-4023-877b-ae340fb616c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.817s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:02.334144 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating instance_info_cache with network_info: [{"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:02.692184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772382.6917086, 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf => ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:13:02.693477 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-395907b1-78ee-44ee-80fe-f9c47bb04a3d for instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:13:02.695279 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully detached device vdb from instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf from the live domain config.
May 26 05:13:02.696061 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:13:02.696432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:02.696588 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:02.835907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Releasing lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:02.836257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance network_info: |[{"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:13:02.837683 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Start _get_guest_xml network_info=[{"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:13:02.839601 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:13:02.840774 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-841319391', uuid='f9e865ec-7570-49b8-9c4e-f3ba5b32b022'), owner=OwnerMeta(userid='f737dd526dff4402bb2deb8e2fe56f2b', username='tempest-TestEncryptedCinderVolumes-2040747730-project-member', projectid='495b51ea0c0f4e2f996fbd7a5ccdf223', projectname='tempest-TestEncryptedCinderVolumes-2040747730'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772382.8404462) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:13:02.841771 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:13:02.842074 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:13:02.842980 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:13:02.844328 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:13:02.844328 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:13:02.844636 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:13:02.844749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:13:02.844870 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:13:02.844975 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:13:02.845072 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:13:02.845174 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:13:02.845354 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:13:02.845447 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:13:02.845569 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:13:02.845697 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:13:02.845831 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:13:02.856270 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-841319391',display_name='tempest-TestEncryptedCinderVolumes-server-841319391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-841319391',id=57,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ria5Qay0bvPQtsZdT2RJEdiO9nBx8GLcZuJZWVamRPHxaGlRKUT2qx3Px3GhxPfTaWP5B02KwRao/aRXzEGeDqiQtOKMbqlwT9y3zBoLa4INi/rrUEUvu1T3Xl0dytg==',key_name='tempest-keypair-61958435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-gpu4gvir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=f9e865ec-7570-49b8-9c4e-f3ba5b32b022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:13:02.856514 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:02.857146 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:02.858006 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'pci_devices' on Instance uuid f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:03.360947 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] End _get_guest_xml xml=<domain type="qemu">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <uuid>f9e865ec-7570-49b8-9c4e-f3ba5b32b022</uuid>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <name>instance-00000039</name>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-841319391</nova:name>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:13:02</nova:creationTime>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:user uuid="f737dd526dff4402bb2deb8e2fe56f2b">tempest-TestEncryptedCinderVolumes-2040747730-project-member</nova:user>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:project uuid="495b51ea0c0f4e2f996fbd7a5ccdf223">tempest-TestEncryptedCinderVolumes-2040747730</nova:project>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         <nova:port uuid="9b1bd52b-419a-4a32-896f-c68274cb3be2">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <system>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="serial">f9e865ec-7570-49b8-9c4e-f3ba5b32b022</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="uuid">f9e865ec-7570-49b8-9c4e-f3ba5b32b022</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </system>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <os>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </os>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <features>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </features>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   <devices>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.config"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:0a:c9:c0"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <target dev="tap9b1bd52b-41"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </interface>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/console.log" append="off"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </serial>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <video>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </video>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </rng>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:   </devices>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]: </domain>
May 26 05:13:03.360947 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Preparing to wait for external event network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-841319391',display_name='tempest-TestEncryptedCinderVolumes-server-841319391',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-841319391',id=57,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ria5Qay0bvPQtsZdT2RJEdiO9nBx8GLcZuJZWVamRPHxaGlRKUT2qx3Px3GhxPfTaWP5B02KwRao/aRXzEGeDqiQtOKMbqlwT9y3zBoLa4INi/rrUEUvu1T3Xl0dytg==',key_name='tempest-keypair-61958435',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-gpu4gvir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=f9e865ec-7570-49b8-9c4e-f3ba5b32b022,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:03.363122 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:03.363515 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:13:03.363577 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.363773 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:03.364021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:13:03.365267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.365413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc347ec8-02de-55c8-b747-563ec6fd5114', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:03.366007 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.366803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:03.366997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.369035 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.369145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9b1bd52b-41, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:03.369453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9b1bd52b-41, col_values=(('qos', UUID('a25afa4e-a414-445c-b25b-f68765b3b4c3')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:03.369585 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9b1bd52b-41, col_values=(('external_ids', {'iface-id': '9b1bd52b-419a-4a32-896f-c68274cb3be2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:c9:c0', 'vm-uuid': 'f9e865ec-7570-49b8-9c4e-f3ba5b32b022'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:03.370210 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.371254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:03.375748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:03.376295 np0000001388 nova-compute[98319]: INFO os_vif [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41')
May 26 05:13:03.779934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:03.780074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:04.282107 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:13:04.343121 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005419459998847742 future=<Future at 0x7d7aa43b7950 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:04.343272 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:04.343389 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.312666171000274 future=<Future at 0x7d7aa43a32c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:04.343499 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=6.312578847000168 future=<Future at 0x7d7aa43a32c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:04.343897 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Emitting event <LifecycleEvent: 1779772369.342483, 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:04.344033 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] VM Stopped (Lifecycle Event)
May 26 05:13:04.355010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.658s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:04.356297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '395907b1-78ee-44ee-80fe-f9c47bb04a3d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:13:04.356501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:13:04.380622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:13:04.380622 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:13:04.380622 np0000001388 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:04.380622 np0000001388 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:04.380622 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:04.380819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsi session list stdout=tcp: [149] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:13:04.380819 np0000001388 nova-compute[98319]: tcp: [150] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d (non-flash)
May 26 05:13:04.380819 np0000001388 nova-compute[98319]: tcp: [151] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:04.380819 np0000001388 nova-compute[98319]: tcp: [152] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:04.380819 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:04.380919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', '149'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', '150'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '151'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '152')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:13:04.380919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', '150')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:13:04.381733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d', '149')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:13:04.382333 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c3f60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:13:04.382522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:13:04.382730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Flush multipath device 330000000a537c62c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:13:04.418161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:13:04.468061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:13:04.510669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:13:04.511868 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:13:04.513703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:13:04.524643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:13:04.524785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:13:04.539833 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.570154 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 150, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.40.100,3260]
May 26 05:13:04.570154 np0000001388 nova-compute[98319]: Logout of [sid: 150, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.40.100,3260] successful.
May 26 05:13:04.570154 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.587145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.600299 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.630340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 149, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.50.100,3260]
May 26 05:13:04.630340 np0000001388 nova-compute[98319]: Logout of [sid: 149, target: iqn.2023-03.storpool.com:os--volume-395907b1-78ee-44ee-80fe-f9c47bb04a3d, portal: 192.168.50.100,3260] successful.
May 26 05:13:04.630340 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.649649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:04.649649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:04.649649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] <== disconnect_volume: return (1952ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:04.649649 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:13:04.749520 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:04.750060 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing instance network info cache due to event network-changed-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:04.750238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] Acquiring lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:04.750372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] Acquired lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:04.750494 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Refreshing network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:04.834152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:04.834414 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:04.837546 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:13:04.837670 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Claim successful on node np0000001388
May 26 05:13:04.849384 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 698fc8bc-90d2-4b82-a7ae-6bcc20b253e5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:04.890629 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:04.890807 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:04.891042 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:0a:c9:c0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:13:04.891904 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Using config drive
May 26 05:13:05.204852 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'flavor' on Instance uuid 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:05.252529 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:05.279550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:05.279745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:05.279894 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:05.280020 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:05.280240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:05.282043 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Terminating instance
May 26 05:13:05.403838 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:05.578754 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Creating config drive at /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.config
May 26 05:13:05.583831 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5rabb1j5 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:05.634228 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:05.652700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5rabb1j5" returned: 0 in 0.069s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:05.757881 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updated VIF entry in instance network info cache for port c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:13:05.758260 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [{"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:05.785285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:13:05.808042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:05.809738 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:05.830227 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:05.832762 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:05.867464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.040653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:06.040934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:06.041209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:06.041428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:06.041615 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] No waiting events found dispatching network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:06.041799 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77ed7d9e-17ba-40b5-8611-8c058a22be88 req-bbe18ced-581c-4072-ac1d-849a2ea6097e service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:06.095584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:06.096995 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:06.104280 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.133724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.214253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee1282ef-54ff-48e8-8764-ca3faeb1aaf4 tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.587s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:06.260807 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-af3638c9-8e15-4261-9060-eacfe2de3dcf req-9d50f4f9-e76b-47df-a045-7204920a3e86 service nova] Releasing lock "refresh_cache-7c3de26e-7807-4a99-943a-474537f0e547" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:06.297104 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999640486999851 future=<Future at 0x7d7aa44f3140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:06.300433 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.308626 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Instance destroyed successfully.
May 26 05:13:06.310613 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lazy-loading 'resources' on Instance uuid 7c3de26e-7807-4a99-943a-474537f0e547 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:06.519556 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.527279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.528291 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.548265 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.554588 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.598824 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:06.813481 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:10:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-540168681',display_name='tempest-TestStampPattern-server-540168681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-teststamppattern-server-540168681',id=50,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZqWWj2YrcC+EJCfE3l3yZ1X72+mTeo2vbOcI63SkPXNUNemtKQsw9N/y83eA9IoPWJSf16t21yJekNEaS8rlkXnHScWc3UXUfGdzgdNsXU+AHhQw6ZnQmbWeeKPAgUvg==',key_name='tempest-TestStampPattern-1128248040',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:10:28Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8032d6bd9bb4c029e534ebae5756f21',ramdisk_id='',reservation_id='r-2zchjfbj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-334045049',owner_user_name='tempest-TestStampPattern-334045049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:11:44Z,user_data=None,user_id='ad7c375a52924ea48c19cb93653ea10e',uuid=7c3de26e-7807-4a99-943a-474537f0e547,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:13:06.813708 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converting VIF {"id": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "address": "fa:16:3e:e2:97:44", "network": {"id": "6fbc252d-d506-432e-a4f9-34f93cf030ff", "bridge": "br-int", "label": "tempest-TestStampPattern-962510019-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "e8032d6bd9bb4c029e534ebae5756f21", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ba9bca-ec", "ovs_interfaceid": "c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:06.814448 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:06.814700 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:13:06.817437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.817437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ba9bca-ec, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:06.818695 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.818695 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:06.819157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.819975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.819975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a849f8bd-bf39-486a-89fb-95305515cc79) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:06.820732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.820732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:06.821212 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:06.822737 np0000001388 nova-compute[98319]: INFO os_vif [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:97:44,bridge_name='br-int',has_traffic_filtering=True,id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68,network=Network(6fbc252d-d506-432e-a4f9-34f93cf030ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ba9bca-ec')
May 26 05:13:06.822988 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Deleting instance files /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547_del
May 26 05:13:06.823663 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Deletion of /opt/stack/data/nova/instances/7c3de26e-7807-4a99-943a-474537f0e547_del complete
May 26 05:13:06.955288 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772386.954904, f9e865ec-7570-49b8-9c4e-f3ba5b32b022 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:06.955464 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] VM Started (Lifecycle Event)
May 26 05:13:07.024437 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:07.024604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:07.024770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:07.024914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:07.025043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:07.026944 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Terminating instance
May 26 05:13:07.106601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.272s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:07.107256 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:13:07.329512 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Took 1.54 seconds to destroy the instance on the hypervisor.
May 26 05:13:07.329929 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:13:07.330099 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:13:07.330210 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:13:07.330484 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:07.461852 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:07.469295 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:07.471078 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772387.4692883, f9e865ec-7570-49b8-9c4e-f3ba5b32b022 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:07.473407 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] VM Paused (Lifecycle Event)
May 26 05:13:07.529883 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:13:07.548418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.553680 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.578255 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.588781 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.591137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.615067 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:13:07.615067 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:13:07.615255 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:07.616658 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:07.624525 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.733930 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6abb55160a21467e8a9137d4790b90ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2efc51fa90bd472aa54bd9d44b862522', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:13:07.831741 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:07.832008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:07.832286 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:07.833221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:07.833426 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] No waiting events found dispatching network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:07.833684 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-68d3f743-d32a-4062-b5c7-4af2b9267344 req-76c3ba84-7dc4-49d1-8cb9-eb0886bacebd service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:07.875072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.884471 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:07.914101 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Instance destroyed successfully.
May 26 05:13:07.914824 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lazy-loading 'resources' on Instance uuid 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:07.975893 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:07.977879 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:08.116516 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:08.116727 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Acquiring lock "7c3de26e-7807-4a99-943a-474537f0e547-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:08.116892 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:08.117262 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "7c3de26e-7807-4a99-943a-474537f0e547-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:08.117262 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] No waiting events found dispatching network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:08.117367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-unplugged-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:08.117519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:08.117675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:08.118049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:08.118218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:08.118408 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:13:08.120358 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Processing event network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:13:08.120880 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:08.121026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:08.121193 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:08.121316 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:08.121467 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] No waiting events found dispatching network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:08.121870 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received unexpected event network-vif-plugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 for instance with vm_state building and task_state spawning.
May 26 05:13:08.122014 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Received event network-vif-deleted-c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:08.122427 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Neutron deleted interface c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68; detaching it from the instance and deleting it from the info cache
May 26 05:13:08.122790 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:13:08.123159 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:08.129278 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:13:08.136039 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance spawned successfully.
May 26 05:13:08.136640 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:13:08.297248 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Successfully created port: 7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:13:08.363351 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:08.418153 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:11:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-728134266',display_name='tempest-AttachVolumeNegativeTest-server-728134266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumenegativetest-server-728134266',id=56,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNb8ea1DZUFczZzDktC+PkxaSZoAtVZYlwXrHRK6zbi4mLQUp3ZIU57CC9nJIIc1k0D7dcF6HVfFWXRKE/M75YUwYHEOne70aBTEObtZkjZVpKNqngljMfe6mRAbbyTrNg==',key_name='tempest-keypair-161733652',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:12:12Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23047976f3814538912524932a6a9375',ramdisk_id='',reservation_id='r-zc8xi9o2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1739279332',owner_user_name='tempest-AttachVolumeNegativeTest-1739279332-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:12:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a5137ef274a4a94a48962027c45d899',uuid=9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:13:08.418594 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converting VIF {"id": "304220cc-5dca-4fe1-b744-898d915c2cf1", "address": "fa:16:3e:23:c7:65", "network": {"id": "b9c18843-a618-4de0-8641-4bfe0d07dba3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-496377926-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "23047976f3814538912524932a6a9375", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap304220cc-5d", "ovs_interfaceid": "304220cc-5dca-4fe1-b744-898d915c2cf1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:08.419314 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:08.419680 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:13:08.423506 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:08.423807 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap304220cc-5d, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:08.427836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:08.429230 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:08.430187 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:08.430432 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cffc3dd8-fc00-4232-8456-16c83933c510) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:08.431636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:08.431846 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:08.434717 np0000001388 nova-compute[98319]: INFO os_vif [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:c7:65,bridge_name='br-int',has_traffic_filtering=True,id=304220cc-5dca-4fe1-b744-898d915c2cf1,network=Network(b9c18843-a618-4de0-8641-4bfe0d07dba3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap304220cc-5d')
May 26 05:13:08.435230 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Deleting instance files /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf_del
May 26 05:13:08.436265 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Deletion of /opt/stack/data/nova/instances/9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf_del complete
May 26 05:13:08.482487 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:08.482736 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999866741000005 future=<Future at 0x7d7aa434a900 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:08.482912 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772388.4827287, f9e865ec-7570-49b8-9c4e-f3ba5b32b022 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:08.482964 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] VM Resumed (Lifecycle Event)
May 26 05:13:08.624295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:13:08.629373 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0f00f027-53a0-44e1-b05d-daad2bcff35a req-6fb28bdc-d60a-4f01-8843-829854cc3fe4 service nova] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Detach interface failed, port_id=c2ba9bca-eca2-40f6-88f0-bb8e8bbf9e68, reason: Instance 7c3de26e-7807-4a99-943a-474537f0e547 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.649122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:08.794065 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Successfully updated port: 7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:13:08.833957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-changed-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:08.834133 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Refreshing instance network info cache due to event network-changed-7bf8d06a-6046-494f-afde-73a525434ac5. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:08.834325 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] Acquiring lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:08.834470 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] Acquired lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:08.834617 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Refreshing network info cache for port 7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:08.865540 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Took 1.54 seconds to deallocate network for instance.
May 26 05:13:08.943153 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Took 1.41 seconds to destroy the instance on the hypervisor.
May 26 05:13:08.944132 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:13:08.944321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:13:08.944393 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:13:08.944575 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:08.985264 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:08.986904 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:09.008479 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:09.154057 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Took 8.39 seconds to spawn the instance on the hypervisor.
May 26 05:13:09.154329 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:09.295545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:09.340064 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:09.372830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:09.373088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:09.422720 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:09.491849 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:09.577769 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:09.632049 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:13:09.633097 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:13:09.633384 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Creating image(s)
May 26 05:13:09.633910 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:09.634082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:09.634700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:09.635787 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:09.639041 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:09.644113 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:09.688606 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Took 13.78 seconds to build instance.
May 26 05:13:09.708830 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:09.709027 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:09.740500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:09.740500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:09.740500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:09.740862 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:09.745572 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:13:09.746094 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:09.841935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:09.842454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:09.901518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk 1073741824" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:09.902046 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:09.902509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:09.947476 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:09.948312 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] Acquiring lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:09.948755 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:09.948936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:09.949165 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] No waiting events found dispatching network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:09.949366 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-unplugged-304220cc-5dca-4fe1-b744-898d915c2cf1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:09.949554 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Received event network-vif-deleted-304220cc-5dca-4fe1-b744-898d915c2cf1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:09.949719 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Neutron deleted interface 304220cc-5dca-4fe1-b744-898d915c2cf1; detaching it from the instance and deleting it from the info cache
May 26 05:13:09.949900 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:09.961175 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:09.999935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:10.000434 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:13:10.000774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:10.080825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5e700999-b139-4397-9ad0-cb881faccf43 req-ca8b2543-129a-4458-8d75-295a2ee9c7b7 service nova] Releasing lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:10.082065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquired lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:10.082475 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:13:10.100706 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:10.101261 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Cannot resize image /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:13:10.101682 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:13:10.101920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Ensure instance console log exists: /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:13:10.102283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:10.103624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:10.103852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:10.193592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-df304ecd-03b8-4581-9069-9e9d4f20c3d6 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.291s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:10.211838 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:10.459098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a45f6b50-3d54-4e7a-8eb3-9da3e95a4ed5 req-5a65db7d-c2a6-4d2d-995a-ebfa2e8277f7 service nova] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Detach interface failed, port_id=304220cc-5dca-4fe1-b744-898d915c2cf1, reason: Instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:13:10.463224 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Took 1.52 seconds to deallocate network for instance.
May 26 05:13:10.641967 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:10.656518 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003843849999611848 future=<Future at 0x7d7aa43a32c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:10.656688 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:10.656688 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.5892602499998247 future=<Future at 0x7d7ac43caf00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:10.656775 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.5891854800001965 future=<Future at 0x7d7ac43caf00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:10.657137 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Emitting event <LifecycleEvent: 1779772375.6559944, fc92f62b-3d3a-4e8b-a981-8a57840fb928 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:10.657326 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] VM Stopped (Lifecycle Event)
May 26 05:13:10.718067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.345s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:10.785159 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Deleted allocations for instance 7c3de26e-7807-4a99-943a-474537f0e547
May 26 05:13:10.820804 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:10.971215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:10.971416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:10.978149 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating instance_info_cache with network_info: [{"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:11.145794 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:11.145995 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:11.160127 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1e71996f-9693-4de2-8cba-6ce578d0fad6 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] [instance: fc92f62b-3d3a-4e8b-a981-8a57840fb928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:11.246346 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00035769399983109906 future=<Future at 0x7d7ac43caf00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:11.246968 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772376.2458787, 11fb0123-705b-4023-877b-ae340fb616c2 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:11.247146 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:11.247376 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] VM Stopped (Lifecycle Event)
May 26 05:13:11.248488 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.048232147999897 future=<Future at 0x7d7aa44f3140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:11.248612 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.048092667000219 future=<Future at 0x7d7aa44f3140 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:11.481883 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Releasing lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:11.482294 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance network_info: |[{"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:13:11.484653 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Start _get_guest_xml network_info=[{"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:13:11.486963 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:13:11.491276 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeTestJSON-server-1822016326', uuid='79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48'), owner=OwnerMeta(userid='6abb55160a21467e8a9137d4790b90ad', username='tempest-AttachVolumeTestJSON-1676547055-project-member', projectid='2efc51fa90bd472aa54bd9d44b862522', projectname='tempest-AttachVolumeTestJSON-1676547055'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772391.48825) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:13:11.491276 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:13:11.491276 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:13:11.491617 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:13:11.491695 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:13:11.492793 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:13:11.493183 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:13:11.493585 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:13:11.493746 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:13:11.495228 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:13:11.510413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1822016326',display_name='tempest-AttachVolumeTestJSON-server-1822016326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-1822016326',id=58,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/xlSm7Xmwrp0q5h6SvyQx0jk5qP42eF2vE57baN2Pm1sVR4tCNVP01PwDlTlPmishnszj5zwAQAC+g47/ZPKJ48Q502ncFGrM9rmrm7U/y6Zp7VOolkMd+obUbIXtXHA==',key_name='tempest-keypair-1882122662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-1xdml8ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:13:11.510732 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:11.511525 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:11.512194 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'pci_devices' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:11.648553 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:11.750284 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 11fb0123-705b-4023-877b-ae340fb616c2] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:11.796915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-455b27da-735e-4a1c-837c-63dc2694eb42 tempest-TestStampPattern-334045049 tempest-TestStampPattern-334045049-project-member] Lock "7c3de26e-7807-4a99-943a-474537f0e547" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.517s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:12.014976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] End _get_guest_xml xml=<domain type="qemu">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <uuid>79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48</uuid>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <name>instance-0000003a</name>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:name>tempest-AttachVolumeTestJSON-server-1822016326</nova:name>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:13:11</nova:creationTime>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:user uuid="6abb55160a21467e8a9137d4790b90ad">tempest-AttachVolumeTestJSON-1676547055-project-member</nova:user>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:project uuid="2efc51fa90bd472aa54bd9d44b862522">tempest-AttachVolumeTestJSON-1676547055</nova:project>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         <nova:port uuid="7bf8d06a-6046-494f-afde-73a525434ac5">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <system>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="serial">79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="uuid">79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </system>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <os>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </os>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <features>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </features>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   <devices>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.config"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b0:92:9a"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <target dev="tap7bf8d06a-60"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </interface>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/console.log" append="off"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </serial>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <video>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </video>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </rng>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:   </devices>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]: </domain>
May 26 05:13:12.014976 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Preparing to wait for external event network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1822016326',display_name='tempest-AttachVolumeTestJSON-server-1822016326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-1822016326',id=58,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/xlSm7Xmwrp0q5h6SvyQx0jk5qP42eF2vE57baN2Pm1sVR4tCNVP01PwDlTlPmishnszj5zwAQAC+g47/ZPKJ48Q502ncFGrM9rmrm7U/y6Zp7VOolkMd+obUbIXtXHA==',key_name='tempest-keypair-1882122662',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-1xdml8ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.020397 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a843631-9cca-51ed-9d01-7938ad06df92', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-changed-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Refreshing instance network info cache due to event network-changed-9b1bd52b-419a-4a32-896f-c68274cb3be2. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bf8d06a-60, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] Acquiring lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7bf8d06a-60, col_values=(('qos', UUID('001bd542-ca07-4efd-ab54-4a4163cd1572')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] Acquired lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7bf8d06a-60, col_values=(('external_ids', {'iface-id': '7bf8d06a-6046-494f-afde-73a525434ac5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:92:9a', 'vm-uuid': '79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:12.027663 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Refreshing network info cache for port 9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:12.030112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:12.035092 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.036903 np0000001388 nova-compute[98319]: INFO os_vif [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60')
May 26 05:13:12.154786 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.183s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:12.200774 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Deleted allocations for instance 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf
May 26 05:13:12.532221 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:12.590710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:12.851618 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:12.995970 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updated VIF entry in instance network info cache for port 9b1bd52b-419a-4a32-896f-c68274cb3be2. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:13:12.996447 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating instance_info_cache with network_info: [{"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:13.208865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8bac97ca-bc4f-4fb7-9d60-3d1819015afb tempest-AttachVolumeNegativeTest-1739279332 tempest-AttachVolumeNegativeTest-1739279332-project-member] Lock "9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.184s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:13.498653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b214995c-8463-4d42-b8ae-1bb466cd6cdb req-a3c066e5-89de-434d-96bf-e25ace834efd service nova] Releasing lock "refresh_cache-f9e865ec-7570-49b8-9c4e-f3ba5b32b022" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:13.556688 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:13.556849 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:13.556958 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:b0:92:9a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:13:13.557384 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Using config drive
May 26 05:13:14.064710 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:14.210932 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Creating config drive at /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.config
May 26 05:13:14.215225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfenbu1ci {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:14.272118 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfenbu1ci" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:14.684624 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:14.709462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:14.788497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:14.987839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:14.988504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:15.034173 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28789a82-0879-4498-bc4d-c22f57fc6cc3 req-24a7d8b2-e1a6-4540-b446-0021516d2e1b service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:15.034650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28789a82-0879-4498-bc4d-c22f57fc6cc3 req-24a7d8b2-e1a6-4540-b446-0021516d2e1b service nova] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:15.034650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28789a82-0879-4498-bc4d-c22f57fc6cc3 req-24a7d8b2-e1a6-4540-b446-0021516d2e1b service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:15.034813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28789a82-0879-4498-bc4d-c22f57fc6cc3 req-24a7d8b2-e1a6-4540-b446-0021516d2e1b service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:15.035174 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28789a82-0879-4498-bc4d-c22f57fc6cc3 req-24a7d8b2-e1a6-4540-b446-0021516d2e1b service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Processing event network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:13:15.064068 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:15.064583 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:15.073400 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:15.087947 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:15.449599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:15.475650 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772395.4751723, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:15.476087 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] VM Started (Lifecycle Event)
May 26 05:13:15.479218 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:13:15.481964 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:13:15.489212 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance spawned successfully.
May 26 05:13:15.489212 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:13:15.494663 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:13:15.978822 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:15.980738 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:15.995215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:15.995361 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:15.995573 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:15.995801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:15.996031 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:15.996280 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:16.069634 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:16.069839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:16.078987 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:13:16.079368 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Claim successful on node np0000001388
May 26 05:13:16.483381 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:16.484046 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772396.483475, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:16.484046 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] VM Paused (Lifecycle Event)
May 26 05:13:16.505830 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Took 6.87 seconds to spawn the instance on the hypervisor.
May 26 05:13:16.506068 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:16.987033 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:16.988840 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772396.9885356, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:16.988968 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] VM Resumed (Lifecycle Event)
May 26 05:13:17.016393 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Took 12.23 seconds to build instance.
May 26 05:13:17.028259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:17.113499 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:17.113981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:17.113981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:17.113981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:17.114426 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] No waiting events found dispatching network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:17.114504 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-477d0225-fe85-4562-8f03-7fcbff5b52af req-8b05e0ce-4a3e-4f5c-983c-dc4661292060 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received unexpected event network-vif-plugged-7bf8d06a-6046-494f-afde-73a525434ac5 for instance with vm_state active and task_state None.
May 26 05:13:17.335298 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:17.335522 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:17.492141 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:17.493924 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:17.518755 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.738s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:17.590874 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:17.817823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:17.838032 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:18.249367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-changed-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:18.250622 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Refreshing instance network info cache due to event network-changed-7bf8d06a-6046-494f-afde-73a525434ac5. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:18.250820 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] Acquiring lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:18.250951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] Acquired lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:18.251116 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Refreshing network info cache for port 7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:18.346704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.275s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:18.346704 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:13:18.754845 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:18.853971 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:13:18.854732 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:13:18.855549 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:18.856087 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:18.956189 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60af843351d74dd9b068b684da8584fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa9e17bf6d4b99856c025e45c86c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:13:19.200216 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:19.359385 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:13:19.366840 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updated VIF entry in instance network info cache for port 7bf8d06a-6046-494f-afde-73a525434ac5. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:13:19.367178 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating instance_info_cache with network_info: [{"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:19.579964 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Successfully created port: 233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:13:19.598840 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:19.868010 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:13:19.871500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b7912fd-02a6-45ab-9dc3-1385083516b9 req-e699c54d-ec12-46be-aec1-59d92e36cc92 service nova] Releasing lock "refresh_cache-79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:20.188571 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Successfully updated port: 233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:13:20.256827 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-changed-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:20.258721 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Refreshing instance network info cache due to event network-changed-233392df-9b96-44e5-8803-6991a05cdbc0. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:20.258770 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] Acquiring lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:20.258907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] Acquired lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:20.259135 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Refreshing network info cache for port 233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:20.373172 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Booting with volume 5f10a52e-9001-4978-82aa-e43a0d4765d9 at /dev/vda
May 26 05:13:20.427539 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:20.446278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:13:20.478187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:20.538686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:13:20.540406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:13:20.551671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:13:20.553090 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe0a:c9c0', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:13:20.553294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:13:20.553726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:13:20.553726 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:20.554031 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updating existing volume attachment record: 2a2eb396-2db7-49ba-92f7-067a02035f69 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:13:20.699418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:20.761839 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:20.855421 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:21.033646 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:21.297235 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000475898999866331 future=<Future at 0x7d7aa44f3140 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:21.298500 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Emitting event <LifecycleEvent: 1779772386.2966316, 7c3de26e-7807-4a99-943a-474537f0e547 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:21.298714 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] VM Stopped (Lifecycle Event)
May 26 05:13:21.299965 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:21.300155 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.1824212860001353 future=<Future at 0x7d7aa434a900 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:21.300266 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.1822968920000676 future=<Future at 0x7d7aa434a900 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:21.536127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c46545fb-0028-4c33-9f9f-6d996cd4562e req-fb78dffa-f9d1-49d7-a021-340c052f4f74 service nova] Releasing lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:21.536666 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquired lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:21.536779 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:13:21.802482 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-01e5ebc6-6519-415f-a5ec-92bc0b1db002 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 7c3de26e-7807-4a99-943a-474537f0e547] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:22.035985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:22.094829 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:22.293267 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:22.300749 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:22.446763 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updating instance_info_cache with network_info: [{"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:22.593876 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:22.677717 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:13:22.679003 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:13:22.679436 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Creating image(s)
May 26 05:13:22.680475 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:13:22.680685 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Ensure instance console log exists: /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:13:22.683033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:22.683368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:22.683587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:22.948964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Releasing lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:22.949352 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance network_info: |[{"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:13:22.950149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Start _get_guest_xml network_info=[{"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '2a2eb396-2db7-49ba-92f7-067a02035f69', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '49a10f4d-bf10-4b1b-8965-d3f8cc678d11', 'attached_at': '', 'detached_at': '', 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'serial': '5f10a52e-9001-4978-82aa-e43a0d4765d9'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:13:22.952449 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:13:22.953835 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-769173540', uuid='49a10f4d-bf10-4b1b-8965-d3f8cc678d11'), owner=OwnerMeta(userid='60af843351d74dd9b068b684da8584fc', username='tempest-TestEncryptedCinderVolumes-2082837232-project-member', projectid='71aa9e17bf6d4b99856c025e45c86c48', projectname='tempest-TestEncryptedCinderVolumes-2082837232'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772402.9533777) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:13:22.957007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:13:22.957530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:13:22.958455 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:13:22.958737 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:13:22.959961 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:13:22.960395 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:13:22.960709 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:13:22.960861 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:13:22.961062 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:13:22.961407 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:13:22.961407 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:13:22.961522 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:13:22.961705 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:13:22.961870 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:13:22.962087 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:13:22.962222 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:13:22.990354 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:13:22.990835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:22.991011 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:22.991472 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:22.991730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:13:23.010487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:23.010487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:23.010740 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:23.011716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:23.012053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:23.013095 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:23.028904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:23.028904 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:23.036548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:23.036548 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:23.045804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9] added
May 26 05:13:23.045804 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:23.045804 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:23.045804 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:23.045804 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:23.045804 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:23.045804 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:23.047045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:23.047045 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:23.047499 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:23.051024 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9] added
May 26 05:13:23.051024 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:23.051024 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:23.051024 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:23.051024 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:23.051024 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:23.051024 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:23.051252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:23.051370 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0391(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:23.051527 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:23.483085 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00046288299972729874 future=<Future at 0x7d7aa434a900 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:23.483445 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772388.4825158, 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:23.483586 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:23.483752 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] VM Stopped (Lifecycle Event)
May 26 05:13:23.986034 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 9befa88f-c4aa-48d3-abb9-3b5b4d0ae6bf] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:24.018047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:24.050471 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:24.051817 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:24.063468 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:24.063468 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:24.072588 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:24.072588 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:24.081269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:24.092480 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:24.093046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:13:24.093046 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:24.093491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:13:24.093491 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:24.093600 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:13:24.093600 np0000001388 nova-compute[98319]: 
May 26 05:13:24.106891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:13:24.106891 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:24.107034 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:13:24.107034 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:24.107127 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:13:24.107127 np0000001388 nova-compute[98319]: 
May 26 05:13:25.132692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.40.100,3260]
May 26 05:13:25.132692 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.40.100,3260] successful.
May 26 05:13:25.132692 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:25.139264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.50.100,3260]
May 26 05:13:25.139264 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.50.100,3260] successful.
May 26 05:13:25.139264 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:25.146019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:25.151753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:25.161573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.161573 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.161573 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:25.161782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.161782 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.161782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:25.161970 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:25.162093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:25.162598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('7', '-', '-', 0) found on session 153 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:25.162738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:25.163918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.163918 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.163918 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:25.164269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.164269 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:25.164269 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:25.164602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.153s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:25.164793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:25.165353 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('8', '-', '-', 0) found on session 154 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:25.165492 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:25.179082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 153 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:25.179082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:25.189734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 154 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:25.189734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:26.014414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:13:27.029315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Found WWN 3300000009df22692 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:13:27.029627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.038s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:27.030721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== connect_volume: return (4039ms) {'type': 'block', 'scsi_wwn': '3300000009df22692', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000009df22692'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:27.030721 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009df22692', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '3300000009df22692'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:13:27.036346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:27.082566 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '49a10f4d-bf10-4b1b-8965-d3f8cc678d11', 'attached_at': '', 'detached_at': '', 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'serial': '5f10a52e-9001-4978-82aa-e43a0d4765d9'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:13:27.083990 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:13:27.083990 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:27.083990 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:27.097730 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:13:27.097730 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:13:27.097730 np0000001388 nova-compute[98319]:     <volume>5f10a52e-9001-4978-82aa-e43a0d4765d9</volume>
May 26 05:13:27.097730 np0000001388 nova-compute[98319]:   </usage>
May 26 05:13:27.097730 np0000001388 nova-compute[98319]: </secret>
May 26 05:13:27.097730 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:13:27.121332 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:27.594099 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:27.611105 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-769173540',display_name='tempest-TestEncryptedCinderVolumes-server-769173540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-769173540',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-v7823k0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:20Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=49a10f4d-bf10-4b1b-8965-d3f8cc678d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:13:27.611337 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:27.612161 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:27.614886 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'pci_devices' on Instance uuid 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:28.116183 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] End _get_guest_xml xml=<domain type="qemu">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <uuid>49a10f4d-bf10-4b1b-8965-d3f8cc678d11</uuid>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <name>instance-0000003b</name>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-769173540</nova:name>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:13:22</nova:creationTime>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:user uuid="60af843351d74dd9b068b684da8584fc">tempest-TestEncryptedCinderVolumes-2082837232-project-member</nova:user>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:project uuid="71aa9e17bf6d4b99856c025e45c86c48">tempest-TestEncryptedCinderVolumes-2082837232</nova:project>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <nova:port uuid="233392df-9b96-44e5-8803-6991a05cdbc0">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <system>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="serial">49a10f4d-bf10-4b1b-8965-d3f8cc678d11</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="uuid">49a10f4d-bf10-4b1b-8965-d3f8cc678d11</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </system>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <os>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </os>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <features>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </features>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   <devices>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/disk.config"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <alias name="ua-5f10a52e-9001-4978-82aa-e43a0d4765d9"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <serial>5f10a52e-9001-4978-82aa-e43a0d4765d9</serial>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <encryption format="luks">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:         <secret type="passphrase" uuid="e7bb33d2-9d17-490f-ba5e-bed6b5968e8d"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       </encryption>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:34:b5:99"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <target dev="tap233392df-9b"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </interface>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/console.log" append="off"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </serial>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <video>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </video>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </rng>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:   </devices>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]: </domain>
May 26 05:13:28.116183 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Preparing to wait for external event network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-769173540',display_name='tempest-TestEncryptedCinderVolumes-server-769173540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-769173540',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-v7823k0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:20Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=49a10f4d-bf10-4b1b-8965-d3f8cc678d11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:28.119935 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:13:28.122208 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.122208 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96f168a6-9e92-5628-bdb0-9acc4078e3e0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:28.122208 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.122852 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:28.124726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.124726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap233392df-9b, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:28.125375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap233392df-9b, col_values=(('qos', UUID('cfbe8d92-f98f-4c2b-b317-9f67979e6f72')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:28.125375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap233392df-9b, col_values=(('external_ids', {'iface-id': '233392df-9b96-44e5-8803-6991a05cdbc0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:b5:99', 'vm-uuid': '49a10f4d-bf10-4b1b-8965-d3f8cc678d11'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:28.126533 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.127621 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:28.132407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:28.133190 np0000001388 nova-compute[98319]: INFO os_vif [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b')
May 26 05:13:29.618169 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:29.618567 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:29.658674 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:29.658866 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:29.659023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No VIF found with MAC fa:16:3e:34:b5:99, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:13:29.659580 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Using config drive
May 26 05:13:29.772366 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:30.168494 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:30.293917 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Creating config drive at /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/disk.config
May 26 05:13:30.296914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpriwuymxm {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:30.363032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpriwuymxm" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:30.618654 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:30.621468 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:30.621942 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:30.820017 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:30.850588 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:30.928826 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:31.217850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:31.220165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:31.222573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:31.238102 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:32.595912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:32.621125 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:32.621619 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:32.665550 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772412.6649573, 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:32.665986 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] VM Started (Lifecycle Event)
May 26 05:13:32.950429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:32.950720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:33.126867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:33.169084 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:33.171775 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772413.1714838, 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:33.171887 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] VM Paused (Lifecycle Event)
May 26 05:13:33.452969 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:13:33.501098 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:33.501439 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:33.617725 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:33.618232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:13:33.618232 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:33.674769 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:33.676613 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:34.007373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:34.007565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:34.010215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:13:34.010350 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Claim successful on node np0000001388
May 26 05:13:34.179303 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:34.617672 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:35.122534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:35.226572 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:35.226820 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:35.414389 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2cbdc01-0141-4f33-91f4-f9bbc9ea7497 req-76575e38-d043-4a4a-a591-3f4bcbfb30de service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:35.415675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cbdc01-0141-4f33-91f4-f9bbc9ea7497 req-76575e38-d043-4a4a-a591-3f4bcbfb30de service nova] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:35.415866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cbdc01-0141-4f33-91f4-f9bbc9ea7497 req-76575e38-d043-4a4a-a591-3f4bcbfb30de service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:35.416078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a2cbdc01-0141-4f33-91f4-f9bbc9ea7497 req-76575e38-d043-4a4a-a591-3f4bcbfb30de service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:35.416281 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a2cbdc01-0141-4f33-91f4-f9bbc9ea7497 req-76575e38-d043-4a4a-a591-3f4bcbfb30de service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Processing event network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:13:35.417284 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:13:35.420785 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772415.4202878, 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:35.420785 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] VM Resumed (Lifecycle Event)
May 26 05:13:35.424354 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:13:35.426289 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance spawned successfully.
May 26 05:13:35.428188 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:13:35.730030 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:35.925306 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:35.927029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:35.933969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:35.933969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:35.934128 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:35.934395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:35.934622 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:35.934907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:36.240395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.233s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:36.240765 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:13:36.243074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.121s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:36.243345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:36.243518 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:13:36.429095 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:36.439388 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Took 13.76 seconds to spawn the instance on the hypervisor.
May 26 05:13:36.439631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:36.748848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:13:36.748848 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:13:36.748848 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:36.748848 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:36.829781 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:13:36.948914 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Took 20.95 seconds to build instance.
May 26 05:13:37.251939 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:13:37.265753 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:37.310978 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Successfully created port: 48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:13:37.373515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:37.374171 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:37.451688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.463s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:37.489153 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022/disk --force-share --output=json" returned: 0 in 0.115s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:37.495214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:37.586979 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:37.588592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:37.588933 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:37.589232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:37.589359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] No waiting events found dispatching network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:37.589725 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-168b26b6-2935-4eb2-9f92-e286073124a3 req-246680c6-3c6b-4523-81ba-30659d58414d service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received unexpected event network-vif-plugged-233392df-9b96-44e5-8803-6991a05cdbc0 for instance with vm_state active and task_state None.
May 26 05:13:37.596699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:37.597494 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:37.597810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:37.706038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:37.716688 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:13:37.718796 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:13:37.719872 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:37.761795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:13:37.781447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:37.787491 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13555MB free_disk=72.7635612487793GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:13:37.787491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:37.787491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:37.931985 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Successfully updated port: 48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:13:37.994412 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-changed-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:37.994583 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Refreshing instance network info cache due to event network-changed-48752c00-eb06-4471-a898-400d5e2cac7b. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:37.994787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] Acquiring lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:37.994912 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] Acquired lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:37.995083 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Refreshing network info cache for port 48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:38.128618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:38.268757 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Booting with volume ce3c8d78-1b9e-4b97-b594-f29c529728f8 at /dev/vda
May 26 05:13:38.316347 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:38.327495 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:13:38.351011 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:38.398451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:13:38.398815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:13:38.408387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:13:38.409482 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe0a:c9c0', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0', 'fe80::fc16:3eff:fe34:b599'] 
May 26 05:13:38.409582 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:13:38.409637 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:13:38.409865 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (93ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:38.410077 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Updating existing volume attachment record: 76bcb580-a2dd-4c4b-9817-10067eabcee3 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:13:38.435244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:38.502430 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:38.603540 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:38.796401 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:38.851927 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:13:38.852100 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:13:38.852221 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:13:38.852352 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 06203732-018d-49ce-84ba-d8c499cb0420 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:13:38.852512 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:13:38.852627 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:13:37 up 45 min,  2 users,  load average: 4.86, 5.64, 4.71\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '3', 'num_os_type_None': '4', 'num_proj_495b51ea0c0f4e2f996fbd7a5ccdf223': '1', 'io_workload': '1', 'num_proj_2efc51fa90bd472aa54bd9d44b862522': '1', 'num_proj_71aa9e17bf6d4b99856c025e45c86c48': '1', 'num_vm_building': '1', 'num_task_networking': '1', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:13:39.072009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:13:39.072140 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:13:39.298759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ec052345-ebc4-435e-9c98-ebb51028c1eb req-f1c74e4f-70e7-41b4-9940-611afdb1298c service nova] Releasing lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:39.299258 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:39.299439 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:13:39.574575 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:13:39.643255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-changed-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:39.644216 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Refreshing instance network info cache due to event network-changed-233392df-9b96-44e5-8803-6991a05cdbc0. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:13:39.644591 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] Acquiring lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:13:39.644725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] Acquired lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:13:39.644985 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Refreshing network info cache for port 233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:13:39.860462 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:13:40.037388 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:40.082338 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:13:40.082503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.297s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:40.082765 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:40.147903 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:40.178678 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Updating instance_info_cache with network_info: [{"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:40.456580 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:40.518288 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:13:40.519418 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Creating image(s)
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Ensure instance console log exists: /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:40.521224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:40.604142 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updated VIF entry in instance network info cache for port 233392df-9b96-44e5-8803-6991a05cdbc0. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:13:40.604468 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updating instance_info_cache with network_info: [{"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:40.680979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-06203732-018d-49ce-84ba-d8c499cb0420" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:40.681313 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance network_info: |[{"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:13:40.681886 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Start _get_guest_xml network_info=[{"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '76bcb580-a2dd-4c4b-9817-10067eabcee3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '06203732-018d-49ce-84ba-d8c499cb0420', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'serial': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:13:40.683910 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:13:40.685099 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-831089259', uuid='06203732-018d-49ce-84ba-d8c499cb0420'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772420.6847315) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:13:40.686005 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:13:40.686404 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:13:40.687146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:13:40.687332 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:13:40.688443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:13:40.688712 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:13:40.688860 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:13:40.688950 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:13:40.689099 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:13:40.689248 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:13:40.689349 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:13:40.689522 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:13:40.689632 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:13:40.689871 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:13:40.689973 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:13:40.690109 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:13:40.700828 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:13:40.701139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:40.701362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:40.701730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:40.701917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:13:40.716043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:40.716760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:40.717143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:40.717376 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:40.717984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:40.718186 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:40.728753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:40.728753 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:40.733916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:40.733916 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:40.741435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8] added
May 26 05:13:40.741435 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:40.741435 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:40.741435 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:40.741435 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:40.741435 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:40.741435 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:40.741768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:40.741869 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0244(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:40.742044 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:40.747548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8] added
May 26 05:13:40.747548 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:40.747548 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:40.747548 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:40.747548 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:40.747548 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:40.747548 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:40.747749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:40.747975 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:40.748108 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:41.083111 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:41.083335 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:13:41.083621 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.53 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:41.106638 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1515f70d-249a-4c5e-963d-2d53e5fcd0af req-4f6a0dbf-108a-4cc9-ba9e-498f9964a909 service nova] Releasing lock "refresh_cache-49a10f4d-bf10-4b1b-8965-d3f8cc678d11" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:13:41.742518 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:41.748544 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:41.756628 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:41.756628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:41.763975 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:41.763975 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.771776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.777185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.786779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.786779 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.786779 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:41.787016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.787016 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.787016 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:41.791706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.791706 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.791706 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:41.791889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.791889 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.791889 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:41.817649 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.40.100,3260]
May 26 05:13:41.817649 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.40.100,3260] successful.
May 26 05:13:41.817649 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.828083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.50.100,3260]
May 26 05:13:41.828083 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.50.100,3260] successful.
May 26 05:13:41.828083 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.833017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.839879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:41.852367 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.852367 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.852367 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.852367 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.852367 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:41.852668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.852668 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.852668 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.852668 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.852668 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:41.853119 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:41.853352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:41.854293 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 155 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:41.854512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:41.860780 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.860780 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.860780 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.860780 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.860780 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:41.860954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.860954 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:41.860954 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.860954 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:41.860954 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:41.861230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:41.861416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:41.862114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 156 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:41.862234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:41.883783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 155 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:41.883783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:41.883783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 156 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:41.883783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:41.891488 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:13:42.600981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:42.717788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:13:43.130545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:43.738056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 33000000076422c9a for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:13:43.738304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:43.739584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '33000000076422c9a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000076422c9a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:43.740249 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000076422c9a', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '33000000076422c9a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:13:43.770918 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '06203732-018d-49ce-84ba-d8c499cb0420', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'serial': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:13:43.771591 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:13:43.772015 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:43.772302 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:43.787535 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 26 05:13:43.787822 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:13:43.787958 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:43.788073 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:43.788527 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7d7aa4255a60>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '06203732-018d-49ce-84ba-d8c499cb0420', 'attached_at': '', 'detached_at': '', 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'serial': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:13:43.788615 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] formatting encrypted volume /dev/dm-1 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 26 05:13:47.023211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:47.023695 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:47.527107 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:47.601664 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:47.815060 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:13:47.815060 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:13:47.815060 np0000001388 nova-compute[98319]:     <volume>ce3c8d78-1b9e-4b97-b594-f29c529728f8</volume>
May 26 05:13:47.815060 np0000001388 nova-compute[98319]:   </usage>
May 26 05:13:47.815060 np0000001388 nova-compute[98319]: </secret>
May 26 05:13:47.815060 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:13:48.131478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.323861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831089259',display_name='tempest-TestVolumeBootPattern-server-831089259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-831089259',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-lgv2l7nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:38Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=06203732-018d-49ce-84ba-d8c499cb0420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:13:48.324099 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:48.324697 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:48.325672 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 06203732-018d-49ce-84ba-d8c499cb0420 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:48.533053 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] End _get_guest_xml xml=<domain type="qemu">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <uuid>06203732-018d-49ce-84ba-d8c499cb0420</uuid>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <name>instance-0000003c</name>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-831089259</nova:name>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:13:40</nova:creationTime>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <nova:port uuid="48752c00-eb06-4471-a898-400d5e2cac7b">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <system>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="serial">06203732-018d-49ce-84ba-d8c499cb0420</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="uuid">06203732-018d-49ce-84ba-d8c499cb0420</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </system>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <os>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </os>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <features>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </features>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   <devices>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/disk.config"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <alias name="ua-ce3c8d78-1b9e-4b97-b594-f29c529728f8"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <serial>ce3c8d78-1b9e-4b97-b594-f29c529728f8</serial>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <encryption format="luks">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:         <secret type="passphrase" uuid="88187d25-6eb5-43ad-8243-3b5bce339af5"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       </encryption>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </disk>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b1:bb:1f"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <target dev="tap48752c00-eb"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </interface>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/console.log" append="off"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </serial>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <video>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </video>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </rng>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:   </devices>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: </domain>
May 26 05:13:48.830220 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Preparing to wait for external event network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831089259',display_name='tempest-TestVolumeBootPattern-server-831089259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-831089259',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-lgv2l7nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:13:38Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=06203732-018d-49ce-84ba-d8c499cb0420,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:13:48.830220 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.832953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '055c6a83-f2ef-54f8-b035-e8efcad6b70e', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48752c00-eb, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48752c00-eb, col_values=(('qos', UUID('6606323a-606f-4385-ad72-94951f2598ec')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:48.838218 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48752c00-eb, col_values=(('external_ids', {'iface-id': '48752c00-eb06-4471-a898-400d5e2cac7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:bb:1f', 'vm-uuid': '06203732-018d-49ce-84ba-d8c499cb0420'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:48.839001 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.840337 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:48.845336 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:48.845921 np0000001388 nova-compute[98319]: INFO os_vif [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb')
May 26 05:13:49.603066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:49.603459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:49.603554 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Attaching volume 66749ff4-4270-40dd-8e71-ed224280d130 to /dev/vdb
May 26 05:13:49.652564 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:49.663264 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:13:49.682789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:49.705734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:49.754536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:13:49.755140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe0a:c9c0', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0', 'fe80::fc16:3eff:fe34:b599'] 
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:49.767891 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating existing volume attachment record: ce41b083-041a-4737-847f-f050e7f9e3fd {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:13:50.346026 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'f9e865ec-7570-49b8-9c4e-f3ba5b32b022', 'attached_at': '', 'detached_at': '', 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'serial': '66749ff4-4270-40dd-8e71-ed224280d130'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:13:50.347612 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:13:50.348105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:50.348494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:50.349642 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:50.349642 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:13:50.361304 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:50.361446 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:13:50.361561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:b1:bb:1f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:13:50.362158 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Using config drive
May 26 05:13:50.364718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:50.365543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:50.366166 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:50.366506 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:50.366962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:50.367835 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:50.379715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:50.379715 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:50.386058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:50.386058 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:50.392117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130] added
May 26 05:13:50.392117 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:50.392117 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:50.392117 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:50.392117 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:50.392117 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:50.392117 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:50.392414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:50.392779 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0261(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:50.392779 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:50.397792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130] added
May 26 05:13:50.397792 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:50.397792 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:50.397792 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:50.397792 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:50.397792 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:50.397792 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:50.398136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:50.398136 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:50.398781 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:50.868810 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:51.005457 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Creating config drive at /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/disk.config
May 26 05:13:51.009327 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph0ds08uq {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:51.076035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph0ds08uq" returned: 0 in 0.066s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:13:51.393352 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:51.398983 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:51.409343 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:51.409343 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:13:51.415830 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:13:51.415830 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.425610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.429788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.442838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.442838 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.442838 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.442838 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.442838 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:51.443168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.443168 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.443168 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.443168 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.443168 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:51.444618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.444618 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.444618 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.444618 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.444618 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:51.444948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.444948 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.444948 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.444948 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.444948 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:51.478953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.40.100,3260]
May 26 05:13:51.478953 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.40.100,3260] successful.
May 26 05:13:51.478953 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.490001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.50.100,3260]
May 26 05:13:51.490001 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.50.100,3260] successful.
May 26 05:13:51.490001 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.491266 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.499132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:51.506222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.516647 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.516992 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:51.518807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:51.518807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:51.518807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('11', '-', '-', 0) found on session 157 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:51.518807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:51.519213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:51.523147 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.528102 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:51.528303 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:51.528658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.162s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:51.528658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:13:51.529745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('12', '-', '-', 0) found on session 158 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:13:51.529968 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:13:51.540420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 157 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:51.540420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:51.550404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 158 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:13:51.550404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:13:51.618705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:51.710093 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-064d84fe-f7bf-4abb-8efb-fc9370b28b6d req-0c0a0ad6-69c6-41bd-9369-23f58f8e9a2a service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:51.710441 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-064d84fe-f7bf-4abb-8efb-fc9370b28b6d req-0c0a0ad6-69c6-41bd-9369-23f58f8e9a2a service nova] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:51.711027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-064d84fe-f7bf-4abb-8efb-fc9370b28b6d req-0c0a0ad6-69c6-41bd-9369-23f58f8e9a2a service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:51.712986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-064d84fe-f7bf-4abb-8efb-fc9370b28b6d req-0c0a0ad6-69c6-41bd-9369-23f58f8e9a2a service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:51.713320 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-064d84fe-f7bf-4abb-8efb-fc9370b28b6d req-0c0a0ad6-69c6-41bd-9369-23f58f8e9a2a service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Processing event network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:13:52.008938 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:52.010724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:52.014948 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:52.015926 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:52.030730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:52.366880 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:13:52.604358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:53.216176 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:13:53.219528 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772433.2168202, 06203732-018d-49ce-84ba-d8c499cb0420 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:53.219528 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] VM Started (Lifecycle Event)
May 26 05:13:53.222600 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:13:53.225453 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance spawned successfully.
May 26 05:13:53.227028 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:13:53.384930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found WWN 33000000015a66b9d for multipath device dm-2 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:13:53.385362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:53.386845 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== connect_volume: return (3038ms) {'type': 'block', 'scsi_wwn': '33000000015a66b9d', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000015a66b9d'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:53.387240 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000015a66b9d', 'path': '/dev/disk/by-id/os-brick+dev+dm-2', 'multipath_id': '33000000015a66b9d'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:13:53.389024 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:13:53.389321 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:53.389524 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:53.408072 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 26 05:13:53.408748 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:13:53.409042 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:53.409291 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:13:53.409982 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7d7aa4219070>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': 'f9e865ec-7570-49b8-9c4e-f3ba5b32b022', 'attached_at': '', 'detached_at': '', 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'serial': '66749ff4-4270-40dd-8e71-ed224280d130'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:13:53.410238 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] formatting encrypted volume /dev/dm-2 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 26 05:13:53.721048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:53.734344 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:53.737153 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.737471 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.738001 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.738398 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.738848 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.739235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:13:53.781378 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:53.781559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:53.781719 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:53.781835 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:53.781980 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] No waiting events found dispatching network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:53.782121 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b78906be-86ff-4f28-866f-2c02fd5ff0c5 req-4c046313-3c40-452e-8b3c-4fb195ab1874 service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received unexpected event network-vif-plugged-48752c00-eb06-4471-a898-400d5e2cac7b for instance with vm_state building and task_state spawning.
May 26 05:13:53.847972 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:54.237727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:13:54.237727 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772434.23642, 06203732-018d-49ce-84ba-d8c499cb0420 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:54.237727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] VM Paused (Lifecycle Event)
May 26 05:13:54.244939 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Took 13.73 seconds to spawn the instance on the hypervisor.
May 26 05:13:54.245366 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:54.739510 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:54.740822 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772434.7406518, 06203732-018d-49ce-84ba-d8c499cb0420 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:13:54.741048 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] VM Resumed (Lifecycle Event)
May 26 05:13:54.754512 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Took 20.80 seconds to build instance.
May 26 05:13:55.244501 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:13:55.246273 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:13:55.256358 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.305s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:55.667610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:55.668040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:55.787949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:55.788164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:55.788457 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:55.788601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:55.788742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:55.791397 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Terminating instance
May 26 05:13:56.170878 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:56.296030 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:13:56.316594 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.318655 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.333408 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.335840 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.353853 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.354756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:56.469971 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:56.470390 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:56.471095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:56.471095 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:56.471095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] No waiting events found dispatching network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:56.471095 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cd17145f-6788-4569-91a9-b40d548d87cf req-781b757c-9df6-4385-9e40-84ae13fea09a service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:56.609343 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99970223299988 future=<Future at 0x7d7ac46669f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:56.609611 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.996611556000062 future=<Future at 0x7d7ac46669f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:56.609699 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.996456015000149 future=<Future at 0x7d7ac46669f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:13:56.611425 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Instance destroyed successfully.
May 26 05:13:56.612581 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 06203732-018d-49ce-84ba-d8c499cb0420 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:57.114266 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:13:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-831089259',display_name='tempest-TestVolumeBootPattern-server-831089259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-831089259',id=60,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:13:54Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-lgv2l7nw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:13:54Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=06203732-018d-49ce-84ba-d8c499cb0420,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:13:57.114491 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "48752c00-eb06-4471-a898-400d5e2cac7b", "address": "fa:16:3e:b1:bb:1f", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap48752c00-eb", "ovs_interfaceid": "48752c00-eb06-4471-a898-400d5e2cac7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:13:57.115257 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:13:57.115600 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:13:57.117189 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.117531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48752c00-eb, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:57.118582 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.119331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:57.119953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.120731 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.120871 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6606323a-606f-4385-ad72-94951f2598ec) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:13:57.121339 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.121759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:13:57.122522 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.124325 np0000001388 nova-compute[98319]: INFO os_vif [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:bb:1f,bridge_name='br-int',has_traffic_filtering=True,id=48752c00-eb06-4471-a898-400d5e2cac7b,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48752c00-eb')
May 26 05:13:57.127460 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:13:57.127774 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:57.128037 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:57.128484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:57.128851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'ce3c8d78-1b9e-4b97-b594-f29c529728f8', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:13:57.129039 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:13:57.156839 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [155] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [156] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:13:57.157284 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', '155'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', '156'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c', '159')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:13:57.157284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', '155')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:13:57.158138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8', '156')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:13:57.158918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aec091300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:13:57.159130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:13:57.159421 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 33000000076422c9a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:13:57.175952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:57.190551 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:13:57.243912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:13:57.304646 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:13:57.305013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:13:57.305689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:13:57.316701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:13:57.316854 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:13:57.332212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.369448 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 155, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.40.100,3260]
May 26 05:13:57.369448 np0000001388 nova-compute[98319]: Logout of [sid: 155, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.40.100,3260] successful.
May 26 05:13:57.369448 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.386734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.398093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.437272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.50.100,3260]
May 26 05:13:57.437272 np0000001388 nova-compute[98319]: Logout of [sid: 156, target: iqn.2023-03.storpool.com:os--volume-ce3c8d78-1b9e-4b97-b594-f29c529728f8, portal: 192.168.50.100,3260] successful.
May 26 05:13:57.437272 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.438351 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:13:57.438351 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:13:57.438351 np0000001388 nova-compute[98319]:     <volume>66749ff4-4270-40dd-8e71-ed224280d130</volume>
May 26 05:13:57.438351 np0000001388 nova-compute[98319]:   </usage>
May 26 05:13:57.438351 np0000001388 nova-compute[98319]: </secret>
May 26 05:13:57.438351 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:13:57.446477 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:13:57.452025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:57.453638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:13:57.453761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (326ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:57.453904 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:13:57.454326 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Deleting instance files /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420_del
May 26 05:13:57.454744 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Deletion of /opt/stack/data/nova/instances/06203732-018d-49ce-84ba-d8c499cb0420_del complete
May 26 05:13:57.604292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:13:57.949604 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Attempting to attach volume 66749ff4-4270-40dd-8e71-ed224280d130 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:13:57.950913 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <alias name="ua-66749ff4-4270-40dd-8e71-ed224280d130"/>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <serial>66749ff4-4270-40dd-8e71-ed224280d130</serial>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="d13fb992-c5e6-411e-9928-be7a71bc54af"/>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]: </disk>
May 26 05:13:57.950913 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:13:57.963592 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Took 1.67 seconds to destroy the instance on the hypervisor.
May 26 05:13:57.964234 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:13:57.964451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:13:57.964550 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:13:57.965073 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:58.029013 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:13:58.235220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:58.235220 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:58.235220 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attaching volume 92d8eee6-228e-462d-804c-671534ccc3a2 to /dev/vdb
May 26 05:13:58.258213 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41875b71-b643-4011-97c1-3915654829af req-1c207e01-ea76-4cf3-ac70-d43bf043aaef service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-deleted-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:58.259281 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-41875b71-b643-4011-97c1-3915654829af req-1c207e01-ea76-4cf3-ac70-d43bf043aaef service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Neutron deleted interface 48752c00-eb06-4471-a898-400d5e2cac7b; detaching it from the instance and deleting it from the info cache
May 26 05:13:58.259281 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-41875b71-b643-4011-97c1-3915654829af req-1c207e01-ea76-4cf3-ac70-d43bf043aaef service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:58.279395 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:58.295726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:13:58.323223 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:13:58.376145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:13:58.376695 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:13:58.389013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:13:58.390406 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fe0a:c9c0', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0', 'fe80::fc16:3eff:fe34:b599'] 
May 26 05:13:58.390697 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:13:58.390945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:13:58.391299 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:13:58.391666 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating existing volume attachment record: 0a494f00-6d31-4534-bdd9-d4c7e14bc286 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:13:58.533265 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:13:58.533914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] Acquiring lock "06203732-018d-49ce-84ba-d8c499cb0420-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:13:58.534190 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:13:58.534734 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] Lock "06203732-018d-49ce-84ba-d8c499cb0420-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:13:58.534933 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] No waiting events found dispatching network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:13:58.535074 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d20cc37b-0dff-4913-9ac6-11c028f20b08 req-8a124c7c-d542-4721-a6bd-198d5f71616f service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Received event network-vif-unplugged-48752c00-eb06-4471-a898-400d5e2cac7b for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:13:58.710645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:13:58.766515 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-41875b71-b643-4011-97c1-3915654829af req-1c207e01-ea76-4cf3-ac70-d43bf043aaef service nova] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Detach interface failed, port_id=48752c00-eb06-4471-a898-400d5e2cac7b, reason: Instance 06203732-018d-49ce-84ba-d8c499cb0420 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:13:58.960546 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:13:58.960546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:13:58.960546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:58.960546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:58.960546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:13:58.991110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:58.992580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:13:58.993180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:58.993372 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:13:58.994268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:13:58.995053 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:13:59.005917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:59.005917 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:59.012171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:13:59.012171 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:59.019503 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2] added
May 26 05:13:59.019503 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:59.019503 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:59.019503 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:59.019503 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:59.019503 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:59.019503 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:59.019832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:59.019896 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0264(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:59.020102 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:59.026998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2] added
May 26 05:13:59.026998 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:13:59.026998 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:59.026998 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:59.026998 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:13:59.026998 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:13:59.026998 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:13:59.027733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:13:59.028014 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0335(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:13:59.029146 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:13:59.212941 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Took 1.25 seconds to deallocate network for instance.
May 26 05:13:59.758767 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:14:00.020745 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:00.030204 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:00.036396 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:00.036396 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:00.047012 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:00.047012 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.058632 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.063749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.074228 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:00.080430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.080430 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.080430 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.080430 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.080430 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.080430 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:00.081218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.081218 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.081218 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.081218 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.081218 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.081218 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:00.117766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.50.100,3260]
May 26 05:14:00.117766 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.50.100,3260] successful.
May 26 05:14:00.117766 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.129423 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.40.100,3260]
May 26 05:14:00.129423 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.40.100,3260] successful.
May 26 05:14:00.129423 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.130962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.145219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.148910 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.149375 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:00.149830 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:00.150075 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:00.150854 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('9', '-', '-', 0) found on session 160 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:00.151079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.157171 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:00.157544 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:00.157544 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:00.157733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:00.158436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('10', '-', '-', 0) found on session 161 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:00.158533 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:00.168183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 160 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:00.168183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:00.173093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 161 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:00.173093 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:00.265139 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:00.267733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:00.505726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:00.505909 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:00.626239 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:00.626375 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:00.626431 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:00.626595 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:0a:c9:c0, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:00.993726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:14:01.008286 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:01.514125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.246s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:01.567169 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 06203732-018d-49ce-84ba-d8c499cb0420
May 26 05:14:02.008449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found WWN 330000000305dcdba for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:14:02.008843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:02.008874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== connect_volume: return (3049ms) {'type': 'block', 'scsi_wwn': '330000000305dcdba', 'path': '/dev/dm-1', 'multipath_id': '330000000305dcdba'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:02.008975 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000305dcdba', 'path': '/dev/dm-1', 'multipath_id': '330000000305dcdba'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:14:02.011430 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:02.123137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:02.186265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8c4ef4b5-5009-493f-9449-c9c2697de3f3 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.583s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:02.514089 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attempting to attach volume 92d8eee6-228e-462d-804c-671534ccc3a2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:14:02.517968 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:   <alias name="ua-92d8eee6-228e-462d-804c-671534ccc3a2"/>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:   <serial>92d8eee6-228e-462d-804c-671534ccc3a2</serial>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:02.517968 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:14:02.579097 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-620e1b2f-b561-435b-b216-c4f9970ba17e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "06203732-018d-49ce-84ba-d8c499cb0420" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.790s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:02.607746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:02.694402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:02.694961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:03.197365 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Detaching volume 66749ff4-4270-40dd-8e71-ed224280d130
May 26 05:14:03.244899 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Attempting to driver detach volume 66749ff4-4270-40dd-8e71-ed224280d130 from mountpoint /dev/vdb
May 26 05:14:03.279102 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, 'status': 'reserved', 'instance': 'f9e865ec-7570-49b8-9c4e-f3ba5b32b022', 'attached_at': '', 'detached_at': '', 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'serial': '66749ff4-4270-40dd-8e71-ed224280d130'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:14:03.282536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-66749ff4-4270-40dd-8e71-ed224280d130 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:03.283779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-66749ff4-4270-40dd-8e71-ed224280d130 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:03.283904 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Attempting to detach device vdb from instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:14:03.284165 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <alias name="ua-66749ff4-4270-40dd-8e71-ed224280d130"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <serial>66749ff4-4270-40dd-8e71-ed224280d130</serial>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="d13fb992-c5e6-411e-9928-be7a71bc54af"/>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:03.284165 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:03.289615 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 from the persistent domain config.
May 26 05:14:03.289791 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] (1/8): Attempting to detach device vdb with device alias ua-66749ff4-4270-40dd-8e71-ed224280d130 from instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:14:03.290049 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <alias name="ua-66749ff4-4270-40dd-8e71-ed224280d130"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-2"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <serial>66749ff4-4270-40dd-8e71-ed224280d130</serial>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="d13fb992-c5e6-411e-9928-be7a71bc54af"/>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:03.290049 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:03.750071 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772443.7496765, f9e865ec-7570-49b8-9c4e-f3ba5b32b022 => ua-66749ff4-4270-40dd-8e71-ed224280d130> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:14:03.751828 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-66749ff4-4270-40dd-8e71-ed224280d130 for instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:14:03.757298 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 from the live domain config.
May 26 05:14:03.762886 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:14:03.763330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-2'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:03.763486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:03.763871 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:03.764269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '66749ff4-4270-40dd-8e71-ed224280d130', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-2'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:14:03.764441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [157] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [158] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:03.798463 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '157'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '158'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '161')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:14:03.798463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '157')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:03.799044 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130', '158')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:03.799655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4362d40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:14:03.799825 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:14:03.800125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flush multipath device 33000000015a66b9d {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:14:03.831440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:03.879728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:03.941023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:14:03.941268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:14:03.944713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:14:03.957414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:14:03.958028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:14:03.971482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.006402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 157, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.40.100,3260]
May 26 05:14:04.006402 np0000001388 nova-compute[98319]: Logout of [sid: 157, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.40.100,3260] successful.
May 26 05:14:04.006402 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.024493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.037467 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.071781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 158, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.50.100,3260]
May 26 05:14:04.071781 np0000001388 nova-compute[98319]: Logout of [sid: 158, target: iqn.2023-03.storpool.com:os--volume-66749ff4-4270-40dd-8e71-ed224280d130, portal: 192.168.50.100,3260] successful.
May 26 05:14:04.071781 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.085882 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:04.088221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:04.088221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== disconnect_volume: return (323ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:04.088221 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:14:04.163277 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:04.166242 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:04.166242 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:04.166242 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:b0:92:9a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:04.637863 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:05.651250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ba28f04a-8be4-4e5f-ad9e-aea6af2ad545 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.957s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:05.717789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-654a9d29-ddd1-49d7-b03e-3d173f3dca4f tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.485s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:05.951504 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:05.951760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:05.951968 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:05.952162 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:05.952344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:05.954672 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Terminating instance
May 26 05:14:06.159596 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:06.159828 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:06.457795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:14:06.474267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.475963 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.494727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.518446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.567948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:06.568178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:06.568433 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:06.568896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:06.568896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:06.571285 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Terminating instance
May 26 05:14:06.620187 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:06.620402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:06.620625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:06.620818 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:06.620902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] No waiting events found dispatching network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:06.620952 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a542aae2-b625-4e04-b866-1fae396eee13 req-b6081917-a46f-4b13-88be-e915ddd9383a service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:06.661748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:14:06.746573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.753988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:06.785683 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999747127000319 future=<Future at 0x7d7aa43a9280 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:06.787305 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Instance destroyed successfully.
May 26 05:14:06.787807 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'resources' on Instance uuid f9e865ec-7570-49b8-9c4e-f3ba5b32b022 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:06.943277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:06.944254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:07.074494 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:14:07.097550 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.099869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.117152 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.118481 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.123822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.143574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.208439 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:07.208554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:07.211594 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:14:07.211704 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Claim successful on node np0000001388
May 26 05:14:07.253246 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:07.253473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:07.254010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:07.254397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:07.254598 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] No waiting events found dispatching network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:07.254778 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b02b6cf9-b6a8-4af1-9660-493bfbf8c8d7 req-67857552-f087-404d-a1bc-1253380492bb service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:07.291776 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:12:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-841319391',display_name='tempest-TestEncryptedCinderVolumes-server-841319391',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-841319391',id=57,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1ria5Qay0bvPQtsZdT2RJEdiO9nBx8GLcZuJZWVamRPHxaGlRKUT2qx3Px3GhxPfTaWP5B02KwRao/aRXzEGeDqiQtOKMbqlwT9y3zBoLa4INi/rrUEUvu1T3Xl0dytg==',key_name='tempest-keypair-61958435',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:13:09Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-gpu4gvir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:13:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=f9e865ec-7570-49b8-9c4e-f3ba5b32b022,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:14:07.292019 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "address": "fa:16:3e:0a:c9:c0", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9b1bd52b-41", "ovs_interfaceid": "9b1bd52b-419a-4a32-896f-c68274cb3be2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:07.292594 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:07.292743 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:14:07.293925 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.294220 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9b1bd52b-41, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:07.295314 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.296663 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:07.306307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.307375 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.307704 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a25afa4e-a414-445c-b25b-f68765b3b4c3) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:07.308309 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.308724 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:07.320901 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.324886 np0000001388 nova-compute[98319]: INFO os_vif [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:c9:c0,bridge_name='br-int',has_traffic_filtering=True,id=9b1bd52b-419a-4a32-896f-c68274cb3be2,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9b1bd52b-41')
May 26 05:14:07.325224 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Deleting instance files /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022_del
May 26 05:14:07.325937 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Deletion of /opt/stack/data/nova/instances/f9e865ec-7570-49b8-9c4e-f3ba5b32b022_del complete
May 26 05:14:07.424720 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999677206999877 future=<Future at 0x7d7aeda57b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:07.427177 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Instance destroyed successfully.
May 26 05:14:07.428990 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'resources' on Instance uuid 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:07.446977 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:07.608174 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.832756 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:14:07.833271 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:14:07.833429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:14:07.833519 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:14:07.833778 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:07.920700 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:07.931149 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:13:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-769173540',display_name='tempest-TestEncryptedCinderVolumes-server-769173540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-769173540',id=59,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:13:36Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-v7823k0q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:13:36Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=49a10f4d-bf10-4b1b-8965-d3f8cc678d11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:14:07.931369 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "233392df-9b96-44e5-8803-6991a05cdbc0", "address": "fa:16:3e:34:b5:99", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap233392df-9b", "ovs_interfaceid": "233392df-9b96-44e5-8803-6991a05cdbc0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:07.931799 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:07.931974 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:14:07.932681 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.932842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap233392df-9b, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:07.943683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.944543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:07.945365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.945942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.946075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfbe8d92-f98f-4c2b-b317-9f67979e6f72) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:07.946498 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:07.947293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:07.950493 np0000001388 nova-compute[98319]: INFO os_vif [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:34:b5:99,bridge_name='br-int',has_traffic_filtering=True,id=233392df-9b96-44e5-8803-6991a05cdbc0,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap233392df-9b')
May 26 05:14:07.953254 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:14:07.953604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:07.953784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:07.954208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:07.954574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '5f10a52e-9001-4978-82aa-e43a0d4765d9', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:14:07.954749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:14:07.978665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:07.978665 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:07.978665 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:07.978665 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:07.978665 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:07.978665 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:07.978891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [153] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:07.978891 np0000001388 nova-compute[98319]: tcp: [154] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9 (non-flash)
May 26 05:14:07.978891 np0000001388 nova-compute[98319]: tcp: [159] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c (non-flash)
May 26 05:14:07.978891 np0000001388 nova-compute[98319]: tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:07.978891 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:07.978891 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:07.979001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '153'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '154'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20a6d325-8c02-450f-87e6-6864975f307c', '159'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '161')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:14:07.979145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '153')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:07.980363 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9', '154')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:07.981515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac437bec0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:14:07.981750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:14:07.982037 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flush multipath device 3300000009df22692 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:14:08.018253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:08.077017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:08.126880 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:14:08.127113 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:14:08.128030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:14:08.143337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:14:08.143506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:14:08.156807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.192628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 153, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.40.100,3260]
May 26 05:14:08.192628 np0000001388 nova-compute[98319]: Logout of [sid: 153, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.40.100,3260] successful.
May 26 05:14:08.192628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.206979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.221963 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.248505 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 154, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.50.100,3260]
May 26 05:14:08.248505 np0000001388 nova-compute[98319]: Logout of [sid: 154, target: iqn.2023-03.storpool.com:os--volume-5f10a52e-9001-4978-82aa-e43a0d4765d9, portal: 192.168.50.100,3260] successful.
May 26 05:14:08.248505 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.263126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:08.264091 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:08.264168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== disconnect_volume: return (310ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:08.264322 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:14:08.264556 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Deleting instance files /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11_del
May 26 05:14:08.265027 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Deletion of /opt/stack/data/nova/instances/49a10f4d-bf10-4b1b-8965-d3f8cc678d11_del complete
May 26 05:14:08.430125 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e4092dc2-08a2-4a03-b05a-f0dc35853e79 req-7a302fd6-f3b6-4651-afb0-0ac744a20fc0 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-deleted-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:08.430299 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-e4092dc2-08a2-4a03-b05a-f0dc35853e79 req-7a302fd6-f3b6-4651-afb0-0ac744a20fc0 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Neutron deleted interface 9b1bd52b-419a-4a32-896f-c68274cb3be2; detaching it from the instance and deleting it from the info cache
May 26 05:14:08.430434 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e4092dc2-08a2-4a03-b05a-f0dc35853e79 req-7a302fd6-f3b6-4651-afb0-0ac744a20fc0 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:08.451479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:08.454069 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:08.454362 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:08.673447 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:08.673447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] Acquiring lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:08.673447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:08.673772 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:08.673772 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] No waiting events found dispatching network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:08.673772 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-317c2aa2-ce62-48ca-933f-bb962d52bc8b req-235b9939-75fa-46ec-9afb-1c5e3b4c8ff2 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Received event network-vif-unplugged-9b1bd52b-419a-4a32-896f-c68274cb3be2 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:08.771306 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Took 1.70 seconds to destroy the instance on the hypervisor.
May 26 05:14:08.771878 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:14:08.772256 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:14:08.772372 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:14:08.772606 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:08.833433 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:08.886553 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:08.933516 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e4092dc2-08a2-4a03-b05a-f0dc35853e79 req-7a302fd6-f3b6-4651-afb0-0ac744a20fc0 service nova] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Detach interface failed, port_id=9b1bd52b-419a-4a32-896f-c68274cb3be2, reason: Instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:14:08.957644 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:09.305397 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:09.305782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] Acquiring lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:09.305974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:09.306145 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:09.306311 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] No waiting events found dispatching network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:09.306494 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed65209b-541d-4e29-b601-4e56f3c6bc8b req-8f6ea006-7138-4f63-a29c-fab03c0d3ea1 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-unplugged-233392df-9b96-44e5-8803-6991a05cdbc0 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:09.388446 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Took 1.55 seconds to deallocate network for instance.
May 26 05:14:09.464342 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.256s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:09.464746 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:14:09.522629 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:09.522783 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:09.522967 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attaching volume 12a65aea-73fe-4037-8f1f-80f740caadb0 to /dev/vdc
May 26 05:14:09.555252 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:09.564489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:14:09.583559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:09.625338 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:14:09.625659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:14:09.633476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:14:09.634437 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:14:09.634617 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:14:09.634764 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:14:09.635024 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== get_connector_properties: return (79ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:09.635332 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating existing volume attachment record: 232422a5-5468-4df5-be1c-2ca81ae5310a {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:14:09.679943 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:09.894282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:09.894719 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:09.971106 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:14:09.971346 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:14:09.971620 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:09.971869 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:10.045795 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:14:10.115175 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:10.115414 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:10.181305 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:14:10.181715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:10.181922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:10.182655 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Took 1.41 seconds to deallocate network for instance.
May 26 05:14:10.184812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:10.185211 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:14:10.196307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:10.197060 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:10.197457 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:10.197777 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:10.198158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:10.198358 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:10.210467 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:10.210467 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:10.220861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:10.220861 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:10.222360 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0] added
May 26 05:14:10.222360 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:10.222360 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:10.222360 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:10.222360 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:10.222360 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:10.222360 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:10.222614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:10.222762 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:10.222962 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0] added
May 26 05:14:10.232230 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:10.232230 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:10.232230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:10.232499 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.034(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:10.232499 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:10.431895 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Successfully created port: 8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:14:10.476015 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:14:10.621401 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:10.724961 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:14:10.739029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dd61d902-fa58-4e6a-be21-461702303cae req-d57204ed-1685-4b5f-b442-8d95152c3684 service nova] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Received event network-vif-deleted-233392df-9b96-44e5-8803-6991a05cdbc0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:10.890928 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Successfully updated port: 8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:14:10.932788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-changed-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:10.933118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Refreshing instance network info cache due to event network-changed-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:10.933321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] Acquiring lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:10.933414 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] Acquired lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:10.933533 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Refreshing network info cache for port 8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:10.978046 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:14:11.126850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.232s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:11.170837 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deleted allocations for instance f9e865ec-7570-49b8-9c4e-f3ba5b32b022
May 26 05:14:11.223479 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:11.230075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:11.230299 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:11.233340 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:11.234899 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:11.234899 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:11.245021 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:11.245021 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.249769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.255819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.261136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.261136 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.261136 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:11.261256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.261256 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.261256 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:11.266874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.266874 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.266874 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:11.267020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.267020 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.267020 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:11.288598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.40.100,3260]
May 26 05:14:11.288598 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.40.100,3260] successful.
May 26 05:14:11.288598 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.296711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.50.100,3260]
May 26 05:14:11.296711 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.50.100,3260] successful.
May 26 05:14:11.296711 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.301073 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.309027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.313222 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:11.313538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:11.313538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:11.313962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('7', '-', '-', 0) found on session 162 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:11.314057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:11.320703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.320703 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.320703 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.320703 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.320703 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:11.320847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.320847 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:11.320847 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.320847 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:11.320847 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:11.321125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.123s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:11.321320 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:11.321970 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] HCTL ('8', '-', '-', 0) found on session 163 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:11.322110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:11.328339 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 162 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:11.328339 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:11.336586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Searching for a device in session 163 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:11.336586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:11.392692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:11.393634 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:11.393831 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:11.435343 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:11.481906 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Booting with volume e87a5dec-8a34-4ab7-8a08-122498f29938 at /dev/vda
May 26 05:14:11.494664 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:11.519586 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:11.530126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:14:11.549257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:11.591912 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:14:11.592263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:14:11.601849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:14:11.602644 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:feb0:929a', 'fe80::f0f2:beff:fe22:d7a0'] 
May 26 05:14:11.602760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:14:11.602860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:14:11.603070 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:11.603295 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Updating existing volume attachment record: 6f53c910-de0f-4950-88bc-f530c854dcea {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:14:11.606540 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003414709999560728 future=<Future at 0x7d7ac46669f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:11.606623 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:11.606715 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.17860571500023 future=<Future at 0x7d7aa43a9280 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:11.606790 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.178518280999924 future=<Future at 0x7d7aa43a9280 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:11.607673 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772436.6060975, 06203732-018d-49ce-84ba-d8c499cb0420 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:11.607876 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] VM Stopped (Lifecycle Event)
May 26 05:14:11.631214 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:11.896983 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:12.112549 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ab99d296-1ed6-4e34-ad95-40189c94182e tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 06203732-018d-49ce-84ba-d8c499cb0420] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:12.133059 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-17706971-1bdd-4491-83a1-bf1ffbca6996 req-4cfd30fa-c617-465f-b7d7-a0c63af2afa4 service nova] Releasing lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:12.133454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:12.133616 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:14:12.179211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ed2c15ea-060c-47f0-9cdd-a5ccd8df96e5 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "f9e865ec-7570-49b8-9c4e-f3ba5b32b022" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.227s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:12.198665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:14:12.406864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:12.452414 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deleted allocations for instance 49a10f4d-bf10-4b1b-8965-d3f8cc678d11
May 26 05:14:12.701907 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:12.845889 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:12.952497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:12.952812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:12.952891 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 26 05:14:12.952975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 05:14:12.956409 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:12.956662 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 05:14:12.982355 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Updating instance_info_cache with network_info: [{"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:13.213999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found WWN 3300000000c3b495c for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:14:13.214447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:13.214647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000000c3b495c', 'path': '/dev/dm-0', 'multipath_id': '3300000000c3b495c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:13.214822 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000000c3b495c', 'path': '/dev/dm-0', 'multipath_id': '3300000000c3b495c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:14:13.217505 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:13.459843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b7214717-2f9c-4db7-84eb-74d299c2249b tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "49a10f4d-bf10-4b1b-8965-d3f8cc678d11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.892s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:13.485901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-337e9647-073a-45a3-a862-59bf2ed87928" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:13.486367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance network_info: |[{"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:14:13.694322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:14:13.695382 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:14:13.695603 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Creating image(s)
May 26 05:14:13.695979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:14:13.696256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Ensure instance console log exists: /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:14:13.696498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:13.696661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:13.696763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:13.697236 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Start _get_guest_xml network_info=[{"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '6f53c910-de0f-4950-88bc-f530c854dcea', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '337e9647-073a-45a3-a862-59bf2ed87928', 'attached_at': '', 'detached_at': '', 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'serial': 'e87a5dec-8a34-4ab7-8a08-122498f29938'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:14:13.699247 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:13.700163 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-778992112', uuid='337e9647-073a-45a3-a862-59bf2ed87928'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772453.6998622) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:14:13.700958 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:14:13.701260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:14:13.702035 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:14:13.702739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:14:13.703692 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:14:13.703948 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:14:13.704071 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:14:13.704168 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:14:13.704324 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:14:13.704417 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:14:13.704523 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:14:13.704661 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:14:13.704753 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:14:13.704845 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:14:13.704938 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:14:13.705040 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:14:13.714096 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:14:13.714390 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:13.714489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:13.720090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attempting to attach volume 12a65aea-73fe-4037-8f1f-80f740caadb0 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:14:13.721051 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:   <alias name="ua-12a65aea-73fe-4037-8f1f-80f740caadb0"/>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:   <serial>12a65aea-73fe-4037-8f1f-80f740caadb0</serial>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:13.721051 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:14:15.371262 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:15.371667 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:15.371667 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:15.371667 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:15.371765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] No VIF found with MAC fa:16:3e:b0:92:9a, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:16.470241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.756s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:16.470624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:14:16.482052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:16.483502 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:16.483941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:16.484224 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:16.484727 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:16.484925 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:16.494930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:16.494930 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:16.499746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:16.499746 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:16.507213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938] added
May 26 05:14:16.507213 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:16.507213 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:16.507213 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:16.507213 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:16.507213 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:16.507213 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:16.507432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:16.507614 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:16.507792 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:16.511402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938] added
May 26 05:14:16.511402 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:16.511402 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:16.511402 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:16.511402 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:16.511402 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:16.511402 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:16.511735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:16.511735 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0268(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:16.512111 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:16.533294 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:16.533551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:16.913087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-dd4729a2-642d-43d2-bbbc-5bd7294af793 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.390s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:17.037455 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:14:17.508375 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:17.512103 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:17.520909 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:17.520909 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:17.523877 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:17.523877 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.531519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.539741 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.547127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.547470 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.556138 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.556414 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:17.589875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.40.100,3260]
May 26 05:14:17.589875 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.40.100,3260] successful.
May 26 05:14:17.589875 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.594084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:17.594368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:17.595815 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.50.100,3260]
May 26 05:14:17.595815 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.50.100,3260] successful.
May 26 05:14:17.595815 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.600808 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:14:17.601026 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Claim successful on node np0000001388
May 26 05:14:17.604243 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.611645 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:17.612578 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.619737 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.620064 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:17.620064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:17.620452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:17.620925 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('13', '-', '-', 0) found on session 166 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:17.621037 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:17.636891 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 166 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:17.636891 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('14', '-', '-', 0) found on session 167 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:17.637888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:17.655100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 167 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:17.655100 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:17.683875 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:17.684120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:17.967952 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:18.186898 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Detaching volume 92d8eee6-228e-462d-804c-671534ccc3a2
May 26 05:14:18.245373 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attempting to driver detach volume 92d8eee6-228e-462d-804c-671534ccc3a2 from mountpoint /dev/vdb
May 26 05:14:18.254640 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdb by alias ua-92d8eee6-228e-462d-804c-671534ccc3a2 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:18.256050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdb by alias ua-92d8eee6-228e-462d-804c-671534ccc3a2 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:18.256254 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Attempting to detach device vdb from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:14:18.256623 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <alias name="ua-92d8eee6-228e-462d-804c-671534ccc3a2"/>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <serial>92d8eee6-228e-462d-804c-671534ccc3a2</serial>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:18.256623 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:18.263703 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdb from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the persistent domain config.
May 26 05:14:18.263918 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] (1/8): Attempting to detach device vdb with device alias ua-92d8eee6-228e-462d-804c-671534ccc3a2 from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:14:18.264294 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <alias name="ua-92d8eee6-228e-462d-804c-671534ccc3a2"/>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <serial>92d8eee6-228e-462d-804c-671534ccc3a2</serial>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:18.264294 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:18.484111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:14:18.761048 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772458.7606466, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => ua-92d8eee6-228e-462d-804c-671534ccc3a2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:14:18.762362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-92d8eee6-228e-462d-804c-671534ccc3a2 for instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:14:18.765050 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdb from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the live domain config.
May 26 05:14:18.766319 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:14:18.766704 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:18.766866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:18.786462 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:18.786729 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:19.289513 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:19.504938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 3300000004d4015b1 for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:14:19.505269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:19.506684 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (5791ms) {'type': 'block', 'scsi_wwn': '3300000004d4015b1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000004d4015b1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:19.506844 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004d4015b1', 'path': '/dev/disk/by-id/os-brick+dev+dm-3', 'multipath_id': '3300000004d4015b1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:14:19.507658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.741s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:19.508241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '92d8eee6-228e-462d-804c-671534ccc3a2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:14:19.510230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:14:19.542094 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '337e9647-073a-45a3-a862-59bf2ed87928', 'attached_at': '', 'detached_at': '', 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'serial': 'e87a5dec-8a34-4ab7-8a08-122498f29938'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:14:19.542732 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:14:19.544037 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:19.544037 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:19.544037 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7d7aa44584d0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '337e9647-073a-45a3-a862-59bf2ed87928', 'attached_at': '', 'detached_at': '', 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'serial': 'e87a5dec-8a34-4ab7-8a08-122498f29938'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:14:19.545354 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 26 05:14:19.545518 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] opening encrypted volume /dev/dm-3 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:19.546849 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [160] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [161] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:19.547258 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:19.547536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '160'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '161'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '167')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:14:19.547725 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '161')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:19.549084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2', '160')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:19.551058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c3560>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:14:19.551244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:14:19.551525 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flush multipath device 330000000305dcdba {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:14:19.583237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:19.593356 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 26 05:14:19.593588 np0000001388 nova-compute[98319]: INFO os_brick.encryptors.luks [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] /dev/dm-3 is not a valid LUKS device; formatting device for first use
May 26 05:14:19.593762 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] formatting encrypted volume /dev/dm-3 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 26 05:14:19.661838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:19.701116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:14:19.701423 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:14:19.702601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:14:19.714375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:14:19.714583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:14:19.726316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.754568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 161, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.40.100,3260]
May 26 05:14:19.754568 np0000001388 nova-compute[98319]: Logout of [sid: 161, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.40.100,3260] successful.
May 26 05:14:19.754568 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.774828 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.789877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.798525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.204s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:19.799047 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:14:19.826036 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 160, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.50.100,3260]
May 26 05:14:19.826036 np0000001388 nova-compute[98319]: Logout of [sid: 160, target: iqn.2023-03.storpool.com:os--volume-92d8eee6-228e-462d-804c-671534ccc3a2, portal: 192.168.50.100,3260] successful.
May 26 05:14:19.826036 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.844491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:19.844870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:19.845014 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== disconnect_volume: return (1078ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:19.845124 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:14:20.319225 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:14:20.319225 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:14:20.319225 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:20.319225 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:20.425419 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:20.436908 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f737dd526dff4402bb2deb8e2fe56f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '495b51ea0c0f4e2f996fbd7a5ccdf223', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:14:20.829769 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:14:21.012105 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Successfully created port: 50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:14:21.343908 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:14:21.436930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-81ab72b1-b0cc-437a-8031-c8046cfaba08 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.753s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:21.785825 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004631500000868982 future=<Future at 0x7d7aa43a9280 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:21.785967 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:21.786111 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.6382463519998964 future=<Future at 0x7d7aeda57b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:21.786281 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=0.6381289630003266 future=<Future at 0x7d7aeda57b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:21.786649 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Emitting event <LifecycleEvent: 1779772446.7852492, f9e865ec-7570-49b8-9c4e-f3ba5b32b022 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:21.786903 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] VM Stopped (Lifecycle Event)
May 26 05:14:21.797660 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Successfully updated port: 50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:14:21.883901 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-changed-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:21.883901 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Refreshing instance network info cache due to event network-changed-50b335ac-22a4-4c60-8f0a-dc89b66f23a7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:21.888788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] Acquiring lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:21.890519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] Acquired lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:21.890519 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Refreshing network info cache for port 50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:22.181246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:22.181246 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:22.303975 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b7ea65a2-7ec1-4a62-94c8-227db15757bd tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: f9e865ec-7570-49b8-9c4e-f3ba5b32b022] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:22.305109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:22.358234 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Creating image(s)
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:22.368302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:22.401241 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:22.427146 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.002726280999922892 future=<Future at 0x7d7aeda57b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:22.427374 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:22.428065 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] Emitting event <LifecycleEvent: 1779772447.424293, 49a10f4d-bf10-4b1b-8965-d3f8cc678d11 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:22.428302 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] VM Stopped (Lifecycle Event)
May 26 05:14:22.483387 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:22.484152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:22.484881 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:22.485491 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:22.488586 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:22.489008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:22.508881 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:22.591416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:22.592600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:22.639382 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:22.685163 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Detaching volume 12a65aea-73fe-4037-8f1f-80f740caadb0
May 26 05:14:22.693270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk 1073741824" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:22.698834 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.211s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:22.698834 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:22.754459 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:22.807481 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Attempting to driver detach volume 12a65aea-73fe-4037-8f1f-80f740caadb0 from mountpoint /dev/vdc
May 26 05:14:22.812083 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdc by alias ua-12a65aea-73fe-4037-8f1f-80f740caadb0 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:22.813830 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Found disk vdc by alias ua-12a65aea-73fe-4037-8f1f-80f740caadb0 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:14:22.814074 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Attempting to detach device vdc from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:14:22.814454 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <alias name="ua-12a65aea-73fe-4037-8f1f-80f740caadb0"/>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <serial>12a65aea-73fe-4037-8f1f-80f740caadb0</serial>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:22.814454 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:22.818852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:22.825343 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:14:22.825343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:22.859733 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdc from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the persistent domain config.
May 26 05:14:22.860360 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] (1/8): Attempting to detach device vdc with device alias ua-12a65aea-73fe-4037-8f1f-80f740caadb0 from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:14:22.860903 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <alias name="ua-12a65aea-73fe-4037-8f1f-80f740caadb0"/>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <serial>12a65aea-73fe-4037-8f1f-80f740caadb0</serial>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]: </disk>
May 26 05:14:22.860903 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:14:22.940950 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5f11e5c6-aaf5-4375-b930-901f56e0419b tempest-VolumesBackupsTest-2047315277 tempest-VolumesBackupsTest-2047315277-project-member] [instance: 49a10f4d-bf10-4b1b-8965-d3f8cc678d11] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Cannot resize image /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Ensure instance console log exists: /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:22.948237 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:22.969148 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:23.259505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f48ee1ad-081d-48d9-a0a4-5b49761fc32e req-811b8e2b-4dda-40bc-9e24-660e2f62a49c service nova] Releasing lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:23.260164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquired lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:23.260529 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:14:23.469167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772463.4687269, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => ua-12a65aea-73fe-4037-8f1f-80f740caadb0> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:14:23.470406 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-12a65aea-73fe-4037-8f1f-80f740caadb0 for instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:14:23.473530 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully detached device vdc from instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 from the live domain config.
May 26 05:14:23.475694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:14:23.475855 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:23.476076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:23.476795 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:23.477053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '12a65aea-73fe-4037-8f1f-80f740caadb0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:14:23.477334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsi session list stdout=tcp: [162] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [163] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [164] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [165] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:23.518619 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '162'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '163'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '164'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '165'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '167')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:14:23.518619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '162')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:23.519772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0', '163')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:23.520099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4590720>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:14:23.522408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:14:23.522912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Flush multipath device 3300000000c3b495c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:14:23.563220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:23.607060 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:23.654484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:14:23.654811 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:14:23.655989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:14:23.667515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:14:23.667786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:14:23.684679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.725362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 162, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.40.100,3260]
May 26 05:14:23.725362 np0000001388 nova-compute[98319]: Logout of [sid: 162, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.40.100,3260] successful.
May 26 05:14:23.725362 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.742083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.753703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.803273 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 163, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.50.100,3260]
May 26 05:14:23.803273 np0000001388 nova-compute[98319]: Logout of [sid: 163, target: iqn.2023-03.storpool.com:os--volume-12a65aea-73fe-4037-8f1f-80f740caadb0, portal: 192.168.50.100,3260] successful.
May 26 05:14:23.803273 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.819864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:23.820105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:23.821308 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] <== disconnect_volume: return (344ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:23.821308 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:14:23.902935 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:24.097736 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:24.291015 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating instance_info_cache with network_info: [{"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:24.404868 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'flavor' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:24.794075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Releasing lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:24.794469 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance network_info: |[{"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:14:24.796113 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Start _get_guest_xml network_info=[{"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:14:24.799112 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:24.800436 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-163806220', uuid='c9da37cb-a08c-4258-b4c3-7575088ef1f5'), owner=OwnerMeta(userid='f737dd526dff4402bb2deb8e2fe56f2b', username='tempest-TestEncryptedCinderVolumes-2040747730-project-member', projectid='495b51ea0c0f4e2f996fbd7a5ccdf223', projectname='tempest-TestEncryptedCinderVolumes-2040747730'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772464.8000293) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:14:24.801659 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:14:24.801969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:14:24.803443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:14:24.803443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:14:24.804453 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:14:24.804905 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:14:24.805095 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:14:24.805273 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:14:24.806076 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:14:24.806076 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:14:24.806076 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:14:24.806076 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:14:24.806076 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:14:24.806289 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:14:24.806320 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:14:24.806502 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:14:24.820426 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-163806220',display_name='tempest-TestEncryptedCinderVolumes-server-163806220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-163806220',id=62,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXs7DMMnzGhejZAAOeYFwtyesLhbSG5kxZLlIRz466NGYFCCKtM55GjOYqGTHtSawJR5QS9alHtZcK5KbEJvKSlm25tYVPe+6Yr96osma1eq1PRZkMMhkodlIdcLl2w3w==',key_name='tempest-keypair-714923964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-faunubxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9da37cb-a08c-4258-b4c3-7575088ef1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:14:24.820688 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:24.821372 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:24.822219 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'pci_devices' on Instance uuid c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:25.325127 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] End _get_guest_xml xml=<domain type="qemu">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <uuid>c9da37cb-a08c-4258-b4c3-7575088ef1f5</uuid>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <name>instance-0000003e</name>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-163806220</nova:name>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:14:24</nova:creationTime>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:user uuid="f737dd526dff4402bb2deb8e2fe56f2b">tempest-TestEncryptedCinderVolumes-2040747730-project-member</nova:user>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:project uuid="495b51ea0c0f4e2f996fbd7a5ccdf223">tempest-TestEncryptedCinderVolumes-2040747730</nova:project>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         <nova:port uuid="50b335ac-22a4-4c60-8f0a-dc89b66f23a7">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <system>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="serial">c9da37cb-a08c-4258-b4c3-7575088ef1f5</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="uuid">c9da37cb-a08c-4258-b4c3-7575088ef1f5</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </system>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <os>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </os>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <features>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </features>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   <devices>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.config"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:0e:d3:15"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <target dev="tap50b335ac-22"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </interface>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/console.log" append="off"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </serial>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <video>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </video>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </rng>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:   </devices>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]: </domain>
May 26 05:14:25.325127 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Preparing to wait for external event network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-163806220',display_name='tempest-TestEncryptedCinderVolumes-server-163806220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-163806220',id=62,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXs7DMMnzGhejZAAOeYFwtyesLhbSG5kxZLlIRz466NGYFCCKtM55GjOYqGTHtSawJR5QS9alHtZcK5KbEJvKSlm25tYVPe+6Yr96osma1eq1PRZkMMhkodlIdcLl2w3w==',key_name='tempest-keypair-714923964',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-faunubxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9da37cb-a08c-4258-b4c3-7575088ef1f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:25.327381 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:14:25.327766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.328115 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:25.328512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:14:25.329378 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.329534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f2a49c6-16f4-5fe4-9b53-4a6c8118a4e2', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:25.330358 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.331029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:25.331596 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.334394 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.334584 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50b335ac-22, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:25.334986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50b335ac-22, col_values=(('qos', UUID('43c2bd61-5489-4540-8e0a-9f2f4c3f3bf8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:25.335217 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50b335ac-22, col_values=(('external_ids', {'iface-id': '50b335ac-22a4-4c60-8f0a-dc89b66f23a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:d3:15', 'vm-uuid': 'c9da37cb-a08c-4258-b4c3-7575088ef1f5'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:25.336156 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.337635 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:25.344029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:25.345081 np0000001388 nova-compute[98319]: INFO os_vif [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22')
May 26 05:14:25.422870 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5be9c831-f6f6-43d4-8855-455f17d34e71 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:25.718107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:25.718334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:25.718511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:25.718656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:25.718782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:25.722421 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Terminating instance
May 26 05:14:26.226057 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:14:26.253861 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:26.273480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:26.278260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:26.301920 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:26.492883 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:26.493304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:26.495304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:26.495304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:26.495435 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] No waiting events found dispatching network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:26.496252 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8e691891-3eae-4aa5-9128-619ea58c75d7 req-559143b0-e07d-4934-b165-00c7af608381 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:26.569584 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999645696999778 future=<Future at 0x7d7ac433c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:26.570525 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99871569600009 future=<Future at 0x7d7ac433c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:26.572362 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Instance destroyed successfully.
May 26 05:14:26.573306 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lazy-loading 'resources' on Instance uuid 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:26.575956 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.994667506000042 future=<Future at 0x7d7ac433c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:26.590550 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] opening encrypted volume /dev/dm-3 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 26 05:14:26.865214 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:26.865412 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:26.865580 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:0e:d3:15, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:26.866036 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Using config drive
May 26 05:14:27.076565 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:13:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1822016326',display_name='tempest-AttachVolumeTestJSON-server-1822016326',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-attachvolumetestjson-server-1822016326',id=58,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/xlSm7Xmwrp0q5h6SvyQx0jk5qP42eF2vE57baN2Pm1sVR4tCNVP01PwDlTlPmishnszj5zwAQAC+g47/ZPKJ48Q502ncFGrM9rmrm7U/y6Zp7VOolkMd+obUbIXtXHA==',key_name='tempest-keypair-1882122662',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:13:16Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2efc51fa90bd472aa54bd9d44b862522',ramdisk_id='',reservation_id='r-1xdml8ll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1676547055',owner_user_name='tempest-AttachVolumeTestJSON-1676547055-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:13:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6abb55160a21467e8a9137d4790b90ad',uuid=79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:14:27.077403 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converting VIF {"id": "7bf8d06a-6046-494f-afde-73a525434ac5", "address": "fa:16:3e:b0:92:9a", "network": {"id": "67c8a33c-b14f-4e53-bee0-3758dbdb7edb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-866551251-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "2efc51fa90bd472aa54bd9d44b862522", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bf8d06a-60", "ovs_interfaceid": "7bf8d06a-6046-494f-afde-73a525434ac5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:27.077589 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:27.077857 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:14:27.079136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.082100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bf8d06a-60, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:27.082100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.082435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:27.113470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.116831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.116831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=001bd542-ca07-4efd-ab54-4a4163cd1572) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:27.117756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.119031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:27.124215 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:27.128991 np0000001388 nova-compute[98319]: INFO os_vif [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:92:9a,bridge_name='br-int',has_traffic_filtering=True,id=7bf8d06a-6046-494f-afde-73a525434ac5,network=Network(67c8a33c-b14f-4e53-bee0-3758dbdb7edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bf8d06a-60')
May 26 05:14:27.130049 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Deleting instance files /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48_del
May 26 05:14:27.130189 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Deletion of /opt/stack/data/nova/instances/79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48_del complete
May 26 05:14:27.210757 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:27.211030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:27.371509 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:27.504833 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Creating config drive at /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.config
May 26 05:14:27.506215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp971tro7g {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:27.559497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp971tro7g" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:27.639019 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Took 1.41 seconds to destroy the instance on the hypervisor.
May 26 05:14:27.639318 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:14:27.640183 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:14:27.640183 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:14:27.640183 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:27.714730 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:14:27.720173 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:28.011757 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.032331 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.139603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.142330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.288754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:28.288987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:28.292336 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:14:28.292503 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Claim successful on node np0000001388
May 26 05:14:28.422475 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.433649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.433649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.449922 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:28.562345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:28.563442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] Acquiring lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:28.563977 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:28.563977 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:28.564668 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] No waiting events found dispatching network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:28.564668 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f092a845-fc8b-4772-8aae-8f08d4bcb004 req-945e0adb-3e66-4093-97e6-fc054ddc342f service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-unplugged-7bf8d06a-6046-494f-afde-73a525434ac5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:28.595418 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-37c628d2-af6e-4583-8cae-5026045bad7b req-984601e1-a23e-4e3a-b4e3-697173145825 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:28.595418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37c628d2-af6e-4583-8cae-5026045bad7b req-984601e1-a23e-4e3a-b4e3-697173145825 service nova] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:28.595684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37c628d2-af6e-4583-8cae-5026045bad7b req-984601e1-a23e-4e3a-b4e3-697173145825 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:28.595890 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-37c628d2-af6e-4583-8cae-5026045bad7b req-984601e1-a23e-4e3a-b4e3-697173145825 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:28.596073 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-37c628d2-af6e-4583-8cae-5026045bad7b req-984601e1-a23e-4e3a-b4e3-697173145825 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Processing event network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:14:28.690182 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25012dc2-0365-4f74-834b-f78e61a4c8bd req-fded9e13-5086-4e6a-b1a7-7d2a8cb69c84 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Received event network-vif-deleted-7bf8d06a-6046-494f-afde-73a525434ac5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:28.690380 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-25012dc2-0365-4f74-834b-f78e61a4c8bd req-fded9e13-5086-4e6a-b1a7-7d2a8cb69c84 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Neutron deleted interface 7bf8d06a-6046-494f-afde-73a525434ac5; detaching it from the instance and deleting it from the info cache
May 26 05:14:28.690591 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-25012dc2-0365-4f74-834b-f78e61a4c8bd req-fded9e13-5086-4e6a-b1a7-7d2a8cb69c84 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:28.881506 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772468.8809714, c9da37cb-a08c-4258-b4c3-7575088ef1f5 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:28.881743 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] VM Started (Lifecycle Event)
May 26 05:14:28.883002 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:14:28.886804 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:14:28.889731 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance spawned successfully.
May 26 05:14:28.891259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:14:29.074354 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778992112',display_name='tempest-TestVolumeBootPattern-server-778992112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-778992112',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-p272gkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:11Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=337e9647-073a-45a3-a862-59bf2ed87928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:14:29.074633 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:29.075331 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:29.076078 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 337e9647-073a-45a3-a862-59bf2ed87928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:29.137764 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:29.195066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-25012dc2-0365-4f74-834b-f78e61a4c8bd req-fded9e13-5086-4e6a-b1a7-7d2a8cb69c84 service nova] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Detach interface failed, port_id=7bf8d06a-6046-494f-afde-73a525434ac5, reason: Instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:14:29.384873 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:29.389455 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:29.398234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.398234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.398692 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.398692 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.398926 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.399252 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:29.518722 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:29.518957 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:29.579579 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] End _get_guest_xml xml=<domain type="qemu">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <uuid>337e9647-073a-45a3-a862-59bf2ed87928</uuid>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <name>instance-0000003d</name>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-778992112</nova:name>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:14:13</nova:creationTime>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         <nova:port uuid="8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <system>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="serial">337e9647-073a-45a3-a862-59bf2ed87928</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="uuid">337e9647-073a-45a3-a862-59bf2ed87928</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </system>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <os>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </os>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <features>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </features>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   <devices>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/disk.config"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <alias name="ua-e87a5dec-8a34-4ab7-8a08-122498f29938"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-3"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <serial>e87a5dec-8a34-4ab7-8a08-122498f29938</serial>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:17:3a:12"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <target dev="tap8de0aa1e-d7"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </interface>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/console.log" append="off"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </serial>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <video>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </video>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </rng>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:   </devices>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]: </domain>
May 26 05:14:29.579579 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Preparing to wait for external event network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778992112',display_name='tempest-TestVolumeBootPattern-server-778992112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-778992112',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-p272gkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:11Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=337e9647-073a-45a3-a862-59bf2ed87928,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.584610 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cff1ac52-1eec-55ba-9986-cc076d23181a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:29.585873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.585873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:29.586173 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.589863 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.589863 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8de0aa1e-d7, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:29.589863 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8de0aa1e-d7, col_values=(('qos', UUID('8ffacc80-dc11-4bc0-9e34-d58f50b0289e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:29.590326 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8de0aa1e-d7, col_values=(('external_ids', {'iface-id': '8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:3a:12', 'vm-uuid': '337e9647-073a-45a3-a862-59bf2ed87928'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:29.591009 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.592520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:29.597893 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:29.599063 np0000001388 nova-compute[98319]: INFO os_vif [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7')
May 26 05:14:29.640098 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Took 2.00 seconds to deallocate network for instance.
May 26 05:14:29.891687 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:14:29.891982 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772469.8917758, c9da37cb-a08c-4258-b4c3-7575088ef1f5 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:29.892346 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] VM Paused (Lifecycle Event)
May 26 05:14:29.908890 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Took 7.55 seconds to spawn the instance on the hypervisor.
May 26 05:14:29.909093 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:30.025488 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:30.074314 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:30.146497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:30.394409 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:30.396091 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772470.3958964, c9da37cb-a08c-4258-b4c3-7575088ef1f5 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:30.396218 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] VM Resumed (Lifecycle Event)
May 26 05:14:30.424602 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Took 12.88 seconds to build instance.
May 26 05:14:30.529953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.241s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:30.530450 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.384s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:30.530669 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:14:30.618425 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:30.618860 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:30.697485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:30.697709 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:30.697920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:30.698103 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:30.698467 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] No waiting events found dispatching network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:30.698645 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-8e705bc4-ba17-4228-b8de-981df362f0e8 req-0bc689c7-5029-4a50-9adb-bd5e99ebd845 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received unexpected event network-vif-plugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 for instance with vm_state active and task_state None.
May 26 05:14:30.778043 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:30.778043 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:30.898369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:30.900210 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:30.926015 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.392s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:31.037991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:14:31.038296 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:14:31.038608 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:31.038869 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:31.119520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:31.119520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:31.119520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:17:3a:12, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:31.119520 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Using config drive
May 26 05:14:31.126603 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '60af843351d74dd9b068b684da8584fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71aa9e17bf6d4b99856c025e45c86c48', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:14:31.280625 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:31.545405 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:14:31.561116 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Successfully created port: ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:14:31.627926 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:31.783453 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Creating config drive at /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/disk.config
May 26 05:14:31.786940 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.257s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:31.789703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzeblm06a {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:31.846496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzeblm06a" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:31.852668 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Deleted allocations for instance 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48
May 26 05:14:32.050177 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:14:32.173944 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Successfully updated port: ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:14:32.289660 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.316279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.318907 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.431450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.555284 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Booting with volume 68379437-7b89-4a43-a321-d87e8384e751 at /dev/vda
May 26 05:14:32.616477 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bfda0f0b-d90e-46c1-a1cb-c14c5b16a2b6 req-b6ef51c0-78af-46ba-8ce8-126a5311dc0a service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:32.616754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bfda0f0b-d90e-46c1-a1cb-c14c5b16a2b6 req-b6ef51c0-78af-46ba-8ce8-126a5311dc0a service nova] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:32.616962 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bfda0f0b-d90e-46c1-a1cb-c14c5b16a2b6 req-b6ef51c0-78af-46ba-8ce8-126a5311dc0a service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:32.617110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-bfda0f0b-d90e-46c1-a1cb-c14c5b16a2b6 req-b6ef51c0-78af-46ba-8ce8-126a5311dc0a service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:32.619509 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-bfda0f0b-d90e-46c1-a1cb-c14c5b16a2b6 req-b6ef51c0-78af-46ba-8ce8-126a5311dc0a service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Processing event network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:14:32.621121 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:32.621535 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:32.622355 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:32.622599 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:32.622918 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:32.624412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.639651 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:14:32.668289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:32.681466 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.694180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:32.694479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquired lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:32.694660 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:14:32.700115 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:32.723838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:14:32.724148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:14:32.737098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:14:32.738019 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe0e:d315', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fe17:3a12', 'fe80::5ca0:c8ff:fef8:5735'] 
May 26 05:14:32.738130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:14:32.738267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:14:32.738499 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:32.738680 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updating existing volume attachment record: e78a9e22-8e21-4278-9416-1635e31b68d2 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:14:32.775809 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-changed-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:32.776310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Refreshing instance network info cache due to event network-changed-50b335ac-22a4-4c60-8f0a-dc89b66f23a7. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:32.777438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Acquiring lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:32.777556 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Acquired lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:32.777684 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Refreshing network info cache for port 50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:32.863607 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1ac76f23-88d0-435f-a307-4f39696c5727 tempest-AttachVolumeTestJSON-1676547055 tempest-AttachVolumeTestJSON-1676547055-project-member] Lock "79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:33.211750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:14:33.216003 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772473.2155728, 337e9647-073a-45a3-a862-59bf2ed87928 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:33.216142 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] VM Started (Lifecycle Event)
May 26 05:14:33.217907 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:14:33.222580 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance spawned successfully.
May 26 05:14:33.223121 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:14:33.248714 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:33.280592 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:33.292689 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:33.504909 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:33.506283 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:33.518273 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:33.617737 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:33.617899 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:14:33.618149 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:33.700141 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updating instance_info_cache with network_info: [{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:33.710748 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:33.731130 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:33.735484 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.735702 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.735806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.735977 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.736171 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.736426 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:33.741741 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:33.871710 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updated VIF entry in instance network info cache for port 50b335ac-22a4-4c60-8f0a-dc89b66f23a7. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:14:33.872211 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating instance_info_cache with network_info: [{"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:34.203371 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Releasing lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:34.203604 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Instance network_info: |[{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:14:34.242336 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Took 20.55 seconds to spawn the instance on the hypervisor.
May 26 05:14:34.242499 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:34.246907 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:14:34.247324 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772474.2471342, 337e9647-073a-45a3-a862-59bf2ed87928 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:34.247446 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] VM Paused (Lifecycle Event)
May 26 05:14:34.374369 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Releasing lock "refresh_cache-c9da37cb-a08c-4258-b4c3-7575088ef1f5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:34.374369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-changed-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:34.374369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Refreshing instance network info cache due to event network-changed-ce9c04f4-7e76-455c-9729-d5cbe471c5a4. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:34.374511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Acquiring lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:34.374649 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Acquired lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:34.374649 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Refreshing network info cache for port ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:34.592308 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:34.707892 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:34.708408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:34.708581 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:34.708750 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:34.708887 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] No waiting events found dispatching network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:34.709044 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-ef4821e2-2055-4f5c-a55d-8f3f2e2fe731 req-4495e480-9e3b-41d9-87b8-9c3506d152da service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received unexpected event network-vif-plugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c for instance with vm_state active and task_state None.
May 26 05:14:34.751492 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Took 27.59 seconds to build instance.
May 26 05:14:34.752646 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:34.755728 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772474.7554786, 337e9647-073a-45a3-a862-59bf2ed87928 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:34.755889 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] VM Resumed (Lifecycle Event)
May 26 05:14:34.865691 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:14:34.865691 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:14:34.866362 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Creating image(s)
May 26 05:14:34.866951 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:14:34.869779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Ensure instance console log exists: /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:14:34.869779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:34.869779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:34.869779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:34.869779 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Start _get_guest_xml network_info=[{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'e78a9e22-8e21-4278-9416-1635e31b68d2', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5f5b67bf-5b09-4a67-a1da-1a4a544e3d68', 'attached_at': '', 'detached_at': '', 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'serial': '68379437-7b89-4a43-a321-d87e8384e751'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:14:34.872262 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:34.873791 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestEncryptedCinderVolumes-server-1790156046', uuid='5f5b67bf-5b09-4a67-a1da-1a4a544e3d68'), owner=OwnerMeta(userid='60af843351d74dd9b068b684da8584fc', username='tempest-TestEncryptedCinderVolumes-2082837232-project-member', projectid='71aa9e17bf6d4b99856c025e45c86c48', projectname='tempest-TestEncryptedCinderVolumes-2082837232'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772474.873394) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:14:34.875033 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:14:34.875642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:14:34.876594 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:34.879218 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:14:34.882346 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:14:34.882949 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:14:34.883255 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:14:34.883632 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:14:34.883932 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:14:34.884226 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:14:34.884537 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:14:34.884835 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:14:34.900170 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:14:34.900935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:34.902259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:34.902259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:34.902259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:14:34.922707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:34.923686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:34.924244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:34.924473 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:34.925232 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:34.925599 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:34.938746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:34.938746 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:34.947224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:34.947224 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:34.954344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751] added
May 26 05:14:34.954344 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:34.954344 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:34.954344 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:34.954344 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:34.954344 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:34.954344 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:34.954711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:34.954868 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:34.955072 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:34.961484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751] added
May 26 05:14:34.961484 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:34.961484 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:34.961484 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:34.961484 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:34.961484 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:34.961484 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:34.962696 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:34.962803 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0374(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:34.962926 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:35.253295 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4eb81883-0588-42cb-b2c8-7576b31e8d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.093s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:35.257831 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:35.264409 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:35.277333 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:35.429972 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updated VIF entry in instance network info cache for port ce9c04f4-7e76-455c-9729-d5cbe471c5a4. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:14:35.430898 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updating instance_info_cache with network_info: [{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:35.456052 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:35.457327 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:35.457523 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:35.457645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:35.457760 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] No waiting events found dispatching network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:35.457888 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e219f8a9-27db-4652-af19-4e894f796968 req-8780c01e-4c32-43d0-b8e7-3b4233f4a3c9 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received unexpected event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 for instance with vm_state building and task_state spawning.
May 26 05:14:35.617633 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:35.633414 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:35.633632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:35.633878 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:35.634087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:35.634349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:35.636074 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Terminating instance
May 26 05:14:35.657295 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:35.767254 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] During sync_power_state the instance has a pending task (deleting). Skip.
May 26 05:14:35.933410 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c89a592-da37-4914-bfce-dbe67998ce51 req-03f9dc58-3777-424a-88df-0572e20046f8 service nova] Releasing lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:35.955505 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:35.963479 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:35.969650 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:35.969650 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:35.980523 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:35.980523 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:35.985487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:35.997012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:36.001630 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.001630 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.001630 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:36.001788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.001788 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.001788 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:36.011344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.011344 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.011344 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:36.011552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.011552 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.011552 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:36.037618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.50.100,3260]
May 26 05:14:36.037618 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.50.100,3260] successful.
May 26 05:14:36.037618 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:36.051936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.40.100,3260]
May 26 05:14:36.051936 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.40.100,3260] successful.
May 26 05:14:36.051936 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:36.052562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:36.070773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.070773 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.070773 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.070773 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.070773 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:36.071000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.071000 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.071000 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.071000 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.071000 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:36.071175 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:36.071325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:36.071957 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('7', '-', '-', 0) found on session 168 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:36.072061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:36.074010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:36.086991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 168 and hctl ['7', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:36.095270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.095270 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.095270 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.095270 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.095270 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:36.095577 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.095577 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:36.095577 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.095577 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:36.095577 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:36.095770 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.171s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:36.095935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:36.096742 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] HCTL ('8', '-', '-', 0) found on session 169 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:36.096920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:36.120870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 169 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:36.121165 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:36.123279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:36.124966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:36.125142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:36.125451 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:14:36.141398 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:14:36.172737 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.202562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.230957 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.448408 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.458874 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.485984 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999612023000282 future=<Future at 0x7d7aa446c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:36.489924 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Instance destroyed successfully.
May 26 05:14:36.490786 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 337e9647-073a-45a3-a862-59bf2ed87928 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:36.767883 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:36.768966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:36.769123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:36.769280 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:36.769386 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] No waiting events found dispatching network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:36.769514 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:36.769571 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:36.769686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Acquiring lock "337e9647-073a-45a3-a862-59bf2ed87928-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:36.769794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:36.769882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] Lock "337e9647-073a-45a3-a862-59bf2ed87928-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:36.769976 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] No waiting events found dispatching network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:36.770549 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1f5352c4-2d03-46c2-9935-8279dae7f8f9 req-ec8977b1-740b-4e72-bcfc-0af52dedad1f service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-unplugged-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:14:36.995806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-778992112',display_name='tempest-TestVolumeBootPattern-server-778992112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-778992112',id=61,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:34Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-p272gkyn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:14:34Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=337e9647-073a-45a3-a862-59bf2ed87928,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:14:36.995987 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "address": "fa:16:3e:17:3a:12", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8de0aa1e-d7", "ovs_interfaceid": "8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:36.996618 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:36.996831 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:14:36.997932 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.998120 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8de0aa1e-d7, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:36.998926 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:36.999668 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:37.002003 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:37.002121 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ffacc80-dc11-4bc0-9e34-d58f50b0289e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:37.002505 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:37.003040 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:37.003246 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:37.005085 np0000001388 nova-compute[98319]: INFO os_vif [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:3a:12,bridge_name='br-int',has_traffic_filtering=True,id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8de0aa1e-d7')
May 26 05:14:37.035569 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '337e9647-073a-45a3-a862-59bf2ed87928', 'attached_at': '', 'detached_at': '', 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'serial': 'e87a5dec-8a34-4ab7-8a08-122498f29938'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:14:37.035968 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:14:37.036154 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:37.036305 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:37.036759 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7d7aec112ba0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, 'status': 'reserved', 'instance': '337e9647-073a-45a3-a862-59bf2ed87928', 'attached_at': '', 'detached_at': '', 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'serial': 'e87a5dec-8a34-4ab7-8a08-122498f29938'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:14:37.036866 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] closing encrypted volume /dev/dm-0 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 26 05:14:37.060729 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:14:37.061086 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:37.061340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:37.087433 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Searching for a device in session 168 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:37.087657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:37.154218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:37.258091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:37.258656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:37.354920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:37.359540 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:14:37.361470 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:37.362623 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:37.409076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:37.409644 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13851MB free_disk=72.78845596313477GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:14:37.409795 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:37.410026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:37.635454 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:37.941148 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Found WWN 330000000c068b35f for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:14:37.941735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:37.942669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.881s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:37.943284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e87a5dec-8a34-4ab7-8a08-122498f29938', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:14:37.943611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:14:37.944527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000c068b35f', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000c068b35f'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:37.944836 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000c068b35f', 'path': '/dev/disk/by-id/os-brick+dev+dm-1', 'multipath_id': '330000000c068b35f'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:14:37.968237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:37.968237 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:37.968237 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:37.968237 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:37.968237 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:37.968493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [166] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:37.968493 np0000001388 nova-compute[98319]: tcp: [167] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938 (non-flash)
May 26 05:14:37.968493 np0000001388 nova-compute[98319]: tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:37.968493 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:37.968493 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:37.968673 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '166'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '167'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '169')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:14:37.968864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '166')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:37.970027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938', '167')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:14:37.971005 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f36a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:14:37.971364 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sdi, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:14:37.971694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 3300000004d4015b1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:14:37.984253 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, 'status': 'reserved', 'instance': '5f5b67bf-5b09-4a67-a1da-1a4a544e3d68', 'attached_at': '', 'detached_at': '', 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'serial': '68379437-7b89-4a43-a321-d87e8384e751'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:14:37.984725 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:14:37.984946 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:37.985110 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:14:38.002332 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:14:38.002332 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:14:38.002332 np0000001388 nova-compute[98319]:     <volume>68379437-7b89-4a43-a321-d87e8384e751</volume>
May 26 05:14:38.002332 np0000001388 nova-compute[98319]:   </usage>
May 26 05:14:38.002332 np0000001388 nova-compute[98319]: </secret>
May 26 05:14:38.002332 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:14:38.003019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:38.042351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:14:38.101774 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:14:38.101954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:14:38.103187 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:14:38.115490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:14:38.115670 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:14:38.129519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.156350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.40.100,3260]
May 26 05:14:38.156350 np0000001388 nova-compute[98319]: Logout of [sid: 166, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.40.100,3260] successful.
May 26 05:14:38.156350 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.170644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.183345 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.217337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 167, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.50.100,3260]
May 26 05:14:38.217337 np0000001388 nova-compute[98319]: Logout of [sid: 167, target: iqn.2023-03.storpool.com:os--volume-e87a5dec-8a34-4ab7-8a08-122498f29938, portal: 192.168.50.100,3260] successful.
May 26 05:14:38.217337 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.232986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:38.237614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:38.237807 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (1176ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:38.238086 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:14:38.238550 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Deleting instance files /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928_del
May 26 05:14:38.239089 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Deletion of /opt/stack/data/nova/instances/337e9647-073a-45a3-a862-59bf2ed87928_del complete
May 26 05:14:38.467528 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 337e9647-073a-45a3-a862-59bf2ed87928 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:14:38.467711 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:14:38.467852 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:14:38.468069 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:14:38.468266 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:14:37 up 46 min,  2 users,  load average: 4.12, 5.25, 4.63\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_deleting': '1', 'num_os_type_None': '3', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1', 'io_workload': '1', 'num_task_None': '1', 'num_proj_495b51ea0c0f4e2f996fbd7a5ccdf223': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_71aa9e17bf6d4b99856c025e45c86c48': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:14:38.513981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790156046',display_name='tempest-TestEncryptedCinderVolumes-server-1790156046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1790156046',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-0ai7yt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:32Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=5f5b67bf-5b09-4a67-a1da-1a4a544e3d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:14:38.514171 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:38.514823 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:38.515751 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:38.655026 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:38.655331 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:38.747691 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Took 2.61 seconds to destroy the instance on the hypervisor.
May 26 05:14:38.749156 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:14:38.750222 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:14:38.750222 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:14:38.750444 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:38.846449 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:38.864107 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:39.019532 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] End _get_guest_xml xml=<domain type="qemu">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <uuid>5f5b67bf-5b09-4a67-a1da-1a4a544e3d68</uuid>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <name>instance-0000003f</name>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestEncryptedCinderVolumes-server-1790156046</nova:name>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:14:34</nova:creationTime>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:user uuid="60af843351d74dd9b068b684da8584fc">tempest-TestEncryptedCinderVolumes-2082837232-project-member</nova:user>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:project uuid="71aa9e17bf6d4b99856c025e45c86c48">tempest-TestEncryptedCinderVolumes-2082837232</nova:project>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <nova:port uuid="ce9c04f4-7e76-455c-9729-d5cbe471c5a4">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <system>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="serial">5f5b67bf-5b09-4a67-a1da-1a4a544e3d68</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="uuid">5f5b67bf-5b09-4a67-a1da-1a4a544e3d68</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </system>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <os>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </os>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <features>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </features>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   <devices>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/disk.config"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <alias name="ua-68379437-7b89-4a43-a321-d87e8384e751"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <source dev="/dev/disk/by-id/os-brick+dev+dm-1"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <serial>68379437-7b89-4a43-a321-d87e8384e751</serial>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <encryption format="luks">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:         <secret type="passphrase" uuid="b8411531-ce1f-43c3-a295-d8522e9e8a3f"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       </encryption>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a1:63:54"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <target dev="tapce9c04f4-7e"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </interface>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/console.log" append="off"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </serial>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <video>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </video>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </rng>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:   </devices>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]: </domain>
May 26 05:14:39.019532 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Preparing to wait for external event network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790156046',display_name='tempest-TestEncryptedCinderVolumes-server-1790156046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1790156046',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-0ai7yt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:32Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=5f5b67bf-5b09-4a67-a1da-1a4a544e3d68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2edee8ab-63d7-5334-851f-d8e4f3b645e0', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.027970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:39.028661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.031365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.031365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce9c04f4-7e, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:39.031365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce9c04f4-7e, col_values=(('qos', UUID('9f75113d-e663-48f7-aa1d-edd5b7bab408')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:39.031365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce9c04f4-7e, col_values=(('external_ids', {'iface-id': 'ce9c04f4-7e76-455c-9729-d5cbe471c5a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:63:54', 'vm-uuid': '5f5b67bf-5b09-4a67-a1da-1a4a544e3d68'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:39.031867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.034044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:39.037835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:39.039942 np0000001388 nova-compute[98319]: INFO os_vif [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e')
May 26 05:14:39.043654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:39.049014 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:39.120841 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed069408-dbcb-4379-b9ca-6685ded6d474 req-cfb51a96-d989-4fcb-8503-c4cd39e2adc3 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Received event network-vif-deleted-8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:39.121210 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-ed069408-dbcb-4379-b9ca-6685ded6d474 req-cfb51a96-d989-4fcb-8503-c4cd39e2adc3 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Neutron deleted interface 8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c; detaching it from the instance and deleting it from the info cache
May 26 05:14:39.121438 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ed069408-dbcb-4379-b9ca-6685ded6d474 req-cfb51a96-d989-4fcb-8503-c4cd39e2adc3 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:39.159884 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:39.550040 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:14:39.574218 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:39.624359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed069408-dbcb-4379-b9ca-6685ded6d474 req-cfb51a96-d989-4fcb-8503-c4cd39e2adc3 service nova] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Detach interface failed, port_id=8de0aa1e-d7eb-450f-b3f5-0db585dbbd6c, reason: Instance 337e9647-073a-45a3-a862-59bf2ed87928 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:14:39.667253 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:14:39.667351 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.257s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:39.667705 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:40.078738 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Took 1.33 seconds to deallocate network for instance.
May 26 05:14:40.106488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:40.106488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:40.109346 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:14:40.109346 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Claim successful on node np0000001388
May 26 05:14:40.567661 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:40.567814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:40.567906 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] No VIF found with MAC fa:16:3e:a1:63:54, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:40.568441 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Using config drive
May 26 05:14:40.645505 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Took 0.57 seconds to detach 1 volumes for instance.
May 26 05:14:41.074481 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:41.153192 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:41.204446 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Creating config drive at /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/disk.config
May 26 05:14:41.207854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedd7nr8n {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:41.285469 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpedd7nr8n" returned: 0 in 0.077s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:41.385527 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:41.386041 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:41.569681 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00042385200003991486 future=<Future at 0x7d7ac433c9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:41.570321 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772466.56913, 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:41.570535 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:41.570911 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] VM Stopped (Lifecycle Event)
May 26 05:14:41.572135 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.91340562500045 future=<Future at 0x7d7aa446c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:41.572227 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.913289067000278 future=<Future at 0x7d7aa446c9b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:41.667864 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:14:41.668304 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.95 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:14:41.717955 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:41.748455 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:41.838512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:41.890125 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:42.074625 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 79a8eeb9-07ef-4d91-adfd-dbd30ca0ba48] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:42.112361 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:42.117004 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:42.137521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:42.397245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.290s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:42.397687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:42.398481 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:14:42.515107 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b33ec34-ba97-4563-b8a4-5781c1d11a19 req-ab1b8c2a-644c-4c18-b9a3-96609ccf5075 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:42.515334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b33ec34-ba97-4563-b8a4-5781c1d11a19 req-ab1b8c2a-644c-4c18-b9a3-96609ccf5075 service nova] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:42.515501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b33ec34-ba97-4563-b8a4-5781c1d11a19 req-ab1b8c2a-644c-4c18-b9a3-96609ccf5075 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:42.515642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b33ec34-ba97-4563-b8a4-5781c1d11a19 req-ab1b8c2a-644c-4c18-b9a3-96609ccf5075 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:42.516002 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b33ec34-ba97-4563-b8a4-5781c1d11a19 req-ab1b8c2a-644c-4c18-b9a3-96609ccf5075 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Processing event network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:14:42.637404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:42.660043 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:42.660392 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:42.907853 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:14:42.907853 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:14:42.907853 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:42.907853 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:42.992345 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b515a0ad4e5e46bdb9b8ef1590088c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2daf4310913422fa7ec23fe1a468a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:14:43.162687 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:43.394186 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Successfully created port: dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:14:43.408895 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:14:43.427536 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:14:43.427536 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772483.4271524, 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:43.427536 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] VM Started (Lifecycle Event)
May 26 05:14:43.430829 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:14:43.433667 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Instance spawned successfully.
May 26 05:14:43.433932 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:14:43.668568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.271s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:43.722356 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 337e9647-073a-45a3-a862-59bf2ed87928
May 26 05:14:43.842225 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Successfully updated port: dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:14:43.912369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:14:43.931411 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:43.933153 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:43.940896 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:43.941083 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:43.941392 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:43.941604 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:43.941863 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:43.942159 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:44.033169 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:44.344661 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:44.346357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:44.346357 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:14:44.435383 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:14:44.435778 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772484.4354353, 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:44.435778 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] VM Paused (Lifecycle Event)
May 26 05:14:44.447422 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Took 9.58 seconds to spawn the instance on the hypervisor.
May 26 05:14:44.447638 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:44.590305 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:44.590479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:44.590862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:44.590862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:44.590862 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] No waiting events found dispatching network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:44.591005 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received unexpected event network-vif-plugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 for instance with vm_state active and task_state None.
May 26 05:14:44.591109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:44.591109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing instance network info cache due to event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:44.591232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:44.730673 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c295ae1c-072c-423b-a837-eb69a260ba93 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "337e9647-073a-45a3-a862-59bf2ed87928" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.097s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:44.912266 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:44.919243 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:14:44.920009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:14:44.920220 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Creating image(s)
May 26 05:14:44.920594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:44.920732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:44.921189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:44.921569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:44.921913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:44.938357 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:44.943495 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772484.9432743, 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:44.943634 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] VM Resumed (Lifecycle Event)
May 26 05:14:44.958579 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Took 16.73 seconds to build instance.
May 26 05:14:45.075001 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:45.245134 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:45.448146 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:45.450156 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:45.463343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-37b00e74-a6ea-4191-ad19-45e602055c3a tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.252s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:45.464352 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:45.467623 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:45.468229 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:45.586878 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.part --force-share --output=json" returned: 0 in 0.118s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:45.589026 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] d3410866-a956-493a-912e-57063f45d5a4 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:14:45.590034 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:14:45.590833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.part /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:45.749219 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:45.749931 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance network_info: |[{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:14:45.751459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:45.751709 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:45.802425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.part /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.converted" returned: 0 in 0.211s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:45.807522 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:45.914122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf.converted --force-share --output=json" returned: 0 in 0.106s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:45.914588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.992s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:45.915651 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:45.920287 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:45.922102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:46.013267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:46.013738 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:46.014187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:46.014623 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:46.017227 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:14:46.017554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:46.106681 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:46.107253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf,backing_fmt=raw /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:46.175078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf,backing_fmt=raw /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk 1073741824" returned: 0 in 0.067s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:46.175577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "1fe234a7343e8baa9db6a1024a8711a89153dedf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:46.175939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:46.255870 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:46.279826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:46.283307 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:14:46.283307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:46.379159 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Cannot resize image /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Ensure instance console log exists: /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:46.382215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:46.383610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start _get_guest_xml network_info=[{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T05:14:36Z,direct_url=<?>,disk_format='qcow2',id=d3410866-a956-493a-912e-57063f45d5a4,min_disk=0,min_ram=0,name='tempest-scenario-img--1933869378',owner='a2daf4310913422fa7ec23fe1a468a39',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T05:14:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'd3410866-a956-493a-912e-57063f45d5a4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:14:46.390574 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:46.390574 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='d3410866-a956-493a-912e-57063f45d5a4', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-956764858', uuid='29995f89-a4e7-4ee1-930b-a74135fa6bfc'), owner=OwnerMeta(userid='b515a0ad4e5e46bdb9b8ef1590088c49', username='tempest-TestMinimumBasicScenario-2112472404-project-member', projectid='a2daf4310913422fa7ec23fe1a468a39', projectname='tempest-TestMinimumBasicScenario-2112472404'), image=ImageMeta(id='d3410866-a956-493a-912e-57063f45d5a4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772486.3897698) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:14:46.392833 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:14:46.392833 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:14:46.393677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:14:46.394023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:14:46.395539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:14:46.396078 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T05:14:36Z,direct_url=<?>,disk_format='qcow2',id=d3410866-a956-493a-912e-57063f45d5a4,min_disk=0,min_ram=0,name='tempest-scenario-img--1933869378',owner='a2daf4310913422fa7ec23fe1a468a39',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T05:14:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:14:46.397214 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:14:46.397214 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:14:46.397214 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:14:46.397214 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:14:46.397214 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:14:46.397617 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:14:46.397843 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:14:46.398080 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:14:46.398402 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:14:46.399099 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:14:46.424734 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:44Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:14:46.425111 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:46.426329 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:46.427137 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'pci_devices' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:46.580429 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:46.712786 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updated VIF entry in instance network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:14:46.713072 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] End _get_guest_xml xml=<domain type="qemu">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <uuid>29995f89-a4e7-4ee1-930b-a74135fa6bfc</uuid>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <name>instance-00000040</name>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-956764858</nova:name>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:14:46</nova:creationTime>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:image uuid="d3410866-a956-493a-912e-57063f45d5a4">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:user uuid="b515a0ad4e5e46bdb9b8ef1590088c49">tempest-TestMinimumBasicScenario-2112472404-project-member</nova:user>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:project uuid="a2daf4310913422fa7ec23fe1a468a39">tempest-TestMinimumBasicScenario-2112472404</nova:project>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="d3410866-a956-493a-912e-57063f45d5a4"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         <nova:port uuid="dbf41252-af5f-42e2-9f26-3e1da24bad13">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <system>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="serial">29995f89-a4e7-4ee1-930b-a74135fa6bfc</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="uuid">29995f89-a4e7-4ee1-930b-a74135fa6bfc</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </system>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <os>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </os>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <features>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </features>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   <devices>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </disk>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:dd:90:8e"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <target dev="tapdbf41252-af"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </interface>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/console.log" append="off"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </serial>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <video>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </video>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </rng>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:   </devices>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: </domain>
May 26 05:14:46.932329 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Preparing to wait for external event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:44Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:14:46.932329 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:14:46.935065 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:14:46.935589 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.935913 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:46.936248 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:14:46.936958 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.937132 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a651cc21-b0a7-5189-8e2b-bddd9dd9cd4a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:46.937976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.938874 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:46.939034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.941333 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.941514 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbf41252-af, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:46.941829 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbf41252-af, col_values=(('qos', UUID('5a03f70d-1c60-48db-aac4-1a6e50fb0587')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:46.942005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbf41252-af, col_values=(('external_ids', {'iface-id': 'dbf41252-af5f-42e2-9f26-3e1da24bad13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:8e', 'vm-uuid': '29995f89-a4e7-4ee1-930b-a74135fa6bfc'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:14:46.942725 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.943842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:14:46.949075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:46.950606 np0000001388 nova-compute[98319]: INFO os_vif [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af')
May 26 05:14:47.032669 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-changed-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:47.032669 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Refreshing instance network info cache due to event network-changed-ce9c04f4-7e76-455c-9729-d5cbe471c5a4. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:47.032669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] Acquiring lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:47.032669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] Acquired lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:47.032669 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Refreshing network info cache for port ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:47.215633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3249a8fd-85bb-44fc-a0f2-8f9aec7dd600 req-191fe595-1849-4915-96a3-0f25d4f21bd8 service nova] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:47.536857 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:47.641147 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:47.845228 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:47.985753 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updated VIF entry in instance network info cache for port ce9c04f4-7e76-455c-9729-d5cbe471c5a4. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:14:47.986306 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updating instance_info_cache with network_info: [{"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:48.465148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:48.465148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:14:48.465148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No VIF found with MAC fa:16:3e:dd:90:8e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:14:48.465626 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Using config drive
May 26 05:14:48.489838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ccf63316-a394-418c-ad14-1f6293be19a4 req-9f8c901e-8545-48a1-83ee-fd0382cddc31 service nova] Releasing lock "refresh_cache-5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:48.970397 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:49.093436 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Creating config drive at /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config
May 26 05:14:49.096597 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp932j8_j6 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:49.148978 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp932j8_j6" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:14:49.430297 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:49.430489 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:49.514850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.542301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.629629 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.723644 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-183c098b-beca-4757-8268-d20ba4dabc2d req-83e2267d-eff3-455d-9a3d-2d7f08458ec7 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:49.724107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-183c098b-beca-4757-8268-d20ba4dabc2d req-83e2267d-eff3-455d-9a3d-2d7f08458ec7 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:49.724800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-183c098b-beca-4757-8268-d20ba4dabc2d req-83e2267d-eff3-455d-9a3d-2d7f08458ec7 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:49.724800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-183c098b-beca-4757-8268-d20ba4dabc2d req-83e2267d-eff3-455d-9a3d-2d7f08458ec7 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:49.724800 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-183c098b-beca-4757-8268-d20ba4dabc2d req-83e2267d-eff3-455d-9a3d-2d7f08458ec7 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Processing event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:14:49.858266 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.860659 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.864073 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.883982 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:49.932422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:14:50.243976 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772490.2433443, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:50.244361 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Started (Lifecycle Event)
May 26 05:14:50.245758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:14:50.248910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:14:50.251299 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance spawned successfully.
May 26 05:14:50.253378 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:14:50.477156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:50.477380 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:50.480037 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:14:50.480189 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Claim successful on node np0000001388
May 26 05:14:50.747221 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:50.748785 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:50.761073 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:14:51.250860 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:14:51.251226 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772491.250926, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:51.251226 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Paused (Lifecycle Event)
May 26 05:14:51.264044 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Took 6.34 seconds to spawn the instance on the hypervisor.
May 26 05:14:51.264044 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:51.487745 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.002196099999764556 future=<Future at 0x7d7aa446c9b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:51.488152 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:14:51.488580 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Emitting event <LifecycleEvent: 1779772476.4854321, 337e9647-073a-45a3-a862-59bf2ed87928 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:51.488747 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] VM Stopped (Lifecycle Event)
May 26 05:14:51.681709 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:14:51.681910 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:14:51.753390 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:51.756767 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772491.7565548, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:14:51.756903 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Resumed (Lifecycle Event)
May 26 05:14:51.770999 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Took 11.71 seconds to build instance.
May 26 05:14:51.774599 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:51.775285 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:51.775496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:51.775765 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:51.775834 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:14:51.776001 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b52ab6bc-43df-41fc-ae60-3ce0bdcb5019 req-67b6fa7a-ce89-4a1e-a416-bac498997903 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received unexpected event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with vm_state active and task_state None.
May 26 05:14:51.943584 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:51.991802 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 337e9647-073a-45a3-a862-59bf2ed87928] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:52.184546 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:14:52.258785 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:14:52.260325 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:14:52.271725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d94dc5c3-a7b9-4553-824e-3dfa3b8a2c9c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.228s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:52.641975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:52.690578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.213s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:52.690819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:14:53.198840 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:14:53.201051 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:14:53.201051 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:53.201051 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:53.293222 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:14:53.702933 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:14:53.754216 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Successfully created port: fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:14:53.997971 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:54.211771 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:14:54.270730 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Successfully updated port: fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:14:54.333886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-changed-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:14:54.333886 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Refreshing instance network info cache due to event network-changed-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:14:54.333886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] Acquiring lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:54.333886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] Acquired lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:54.333886 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Refreshing network info cache for port fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:14:54.596536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:54.596819 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:54.716273 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Booting with volume 260a117d-7ffb-444e-95b5-6fa415e51a68 at /dev/vda
May 26 05:14:54.763840 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:54.773509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:14:54.775858 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:14:54.798119 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:54.839292 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:54.847733 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:14:54.848404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:14:54.860484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:14:54.861777 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe0e:d315', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fea1:6354', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fedd:908e', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:14:54.861942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:14:54.862090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:14:54.866219 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:54.866219 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating existing volume attachment record: 9ed3e9d0-b78d-4dab-a8a6-7bf62b1b5951 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:14:54.915946 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:55.072656 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:55.103760 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:14:55.576111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8ea56ffa-1ee5-440f-a4f7-b8d6f0c235e8 req-f19af0cd-0e1c-445d-9218-f347035feb4d service nova] Releasing lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:55.577125 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:14:55.577396 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:14:56.110853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.514s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:56.142398 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:14:56.319654 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:14:56.473941 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating instance_info_cache with network_info: [{"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:14:56.943990 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:56.976255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:14:56.976567 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance network_info: |[{"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:14:56.981412 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:14:56.982442 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:14:56.982685 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Creating image(s)
May 26 05:14:56.982976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:14:56.983112 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Ensure instance console log exists: /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:14:56.983355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:56.983542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:56.983694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:14:56.984117 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Start _get_guest_xml network_info=[{"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '9ed3e9d0-b78d-4dab-a8a6-7bf62b1b5951', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'e9fb74e1-48f0-4de0-83ac-500050e65095', 'attached_at': '', 'detached_at': '', 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'serial': '260a117d-7ffb-444e-95b5-6fa415e51a68'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:14:56.987340 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:14:56.988488 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2072935929', uuid='e9fb74e1-48f0-4de0-83ac-500050e65095'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772496.9881659) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:14:56.989698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:14:56.989989 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:14:56.990713 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:14:56.990864 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:14:56.991659 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:14:56.991901 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:14:56.992020 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:14:56.992108 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:14:56.992275 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:14:56.992357 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:14:56.992453 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:14:56.992620 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:14:56.992740 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:14:56.992881 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:14:56.992984 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:14:56.993092 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:14:57.003118 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:14:57.003378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:57.003605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:57.004029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:57.004206 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:14:57.015394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:57.015935 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:57.016334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:57.016620 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:57.016907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:14:57.017050 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:57.029911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:57.029911 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:57.032784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:14:57.032784 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:57.040918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68] added
May 26 05:14:57.040918 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:57.040918 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:57.040918 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:57.040918 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:57.040918 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:57.040918 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:57.041280 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:57.041280 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0241(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:57.041384 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:57.045271 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68] added
May 26 05:14:57.045271 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:14:57.045271 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:57.045271 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:57.045271 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:14:57.045271 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:14:57.045271 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:57.045475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:14:57.045738 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:14:57.045919 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:14:57.232756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:14:57.232941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:14:57.233122 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attaching volume 83ab3638-64c8-40e5-b87f-5006c6648a82 to /dev/vdb
May 26 05:14:57.269115 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:57.282614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:14:57.305532 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:14:57.353945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:14:57.354316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:14:57.364614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:14:57.366008 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe0e:d315', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fea1:6354', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fedd:908e', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:14:57.366615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:14:57.366852 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:14:57.367213 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== get_connector_properties: return (97ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:14:57.367757 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating existing volume attachment record: a24d41f5-961c-492c-8eff-0b9115b5cdb5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:14:57.644799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:14:57.922180 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:14:57.922738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:14:57.922996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:14:58.041825 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:14:58.046466 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:58.058653 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:58.058653 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:14:58.065556 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:14:58.065556 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.071797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.080255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.091204 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.091204 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.091204 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:58.091938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.091938 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.091938 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:58.098558 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.098558 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.098558 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:58.098921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.098921 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.098921 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:58.129224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.50.100,3260]
May 26 05:14:58.129224 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.50.100,3260] successful.
May 26 05:14:58.129224 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.142451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.153870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.40.100,3260]
May 26 05:14:58.153870 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.40.100,3260] successful.
May 26 05:14:58.153870 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.159706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.159706 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.159706 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.159706 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.159706 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:58.159865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.159865 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.159865 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.159865 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.159865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:58.160172 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:58.160334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:58.161066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 170 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:58.161184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:58.170243 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:14:58.183560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 170 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:58.183560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:58.188571 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.188571 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.188571 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.188571 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.188571 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:14:58.188805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.188805 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:14:58.188805 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.188805 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:14:58.188805 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:14:58.188952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:14:58.189111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:14:58.189680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 171 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:14:58.189945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:14:58.207623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 171 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:14:58.207804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:14:59.017438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:15:00.032959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 330000000e92847b7 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:15:00.033392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:00.033546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000e92847b7', 'path': '/dev/dm-0', 'multipath_id': '330000000e92847b7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:00.033721 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e92847b7', 'path': '/dev/dm-0', 'multipath_id': '330000000e92847b7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:15:00.034292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.111s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:00.034587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:15:00.049292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:00.050417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:00.051006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:00.051313 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:00.052687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:00.052938 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:00.065598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:00.065598 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:00.070448 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:00.070448 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:00.077380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82] added
May 26 05:15:00.077380 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:00.077380 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:00.077380 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:00.077380 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:00.077380 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:00.077380 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:00.077652 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:00.077814 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:00.078002 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:00.081951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82] added
May 26 05:15:00.081951 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:00.081951 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:00.081951 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:00.081951 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:00.081951 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:00.081951 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:00.082147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:00.082328 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0294(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:00.082492 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:00.540288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072935929',display_name='tempest-TestVolumeBootPattern-server-2072935929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2072935929',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCgeCKNxZtqV8TfP0lRr4MRHSxX15otD0IN2i/lRsvJEdEtpxKwdImgCx+JQHjtj5EE93YjXr/AwaR8nH1a0mfAi68BGpYsBrdPInn0t63XmrRmPzcK66W/JX9ybsExGQ==',key_name='tempest-keypair-2081652557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-3gcn6rka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=e9fb74e1-48f0-4de0-83ac-500050e65095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:15:00.540539 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:00.541218 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:00.541949 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid e9fb74e1-48f0-4de0-83ac-500050e65095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:01.044863 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] End _get_guest_xml xml=<domain type="qemu">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <uuid>e9fb74e1-48f0-4de0-83ac-500050e65095</uuid>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <name>instance-00000041</name>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-2072935929</nova:name>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:14:56</nova:creationTime>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         <nova:port uuid="fdcf49d7-16fe-42fe-b52c-7dfec239bb0c">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <system>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="serial">e9fb74e1-48f0-4de0-83ac-500050e65095</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="uuid">e9fb74e1-48f0-4de0-83ac-500050e65095</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </system>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <os>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </os>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <features>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </features>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   <devices>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/disk.config"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </disk>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <alias name="ua-260a117d-7ffb-444e-95b5-6fa415e51a68"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <serial>260a117d-7ffb-444e-95b5-6fa415e51a68</serial>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </disk>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:25:62:3d"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <target dev="tapfdcf49d7-16"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </interface>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/console.log" append="off"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </serial>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <video>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </video>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </rng>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:   </devices>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]: </domain>
May 26 05:15:01.044863 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Preparing to wait for external event network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072935929',display_name='tempest-TestVolumeBootPattern-server-2072935929',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2072935929',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCgeCKNxZtqV8TfP0lRr4MRHSxX15otD0IN2i/lRsvJEdEtpxKwdImgCx+JQHjtj5EE93YjXr/AwaR8nH1a0mfAi68BGpYsBrdPInn0t63XmrRmPzcK66W/JX9ybsExGQ==',key_name='tempest-keypair-2081652557',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-3gcn6rka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:14:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=e9fb74e1-48f0-4de0-83ac-500050e65095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:01.047181 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:15:01.047519 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.047519 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:01.047783 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:15:01.049768 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.049906 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38b91269-c5e8-5d3b-985e-14e58723d2a1', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:01.051842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.051842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:01.052176 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.054038 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.054219 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdcf49d7-16, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:01.054535 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfdcf49d7-16, col_values=(('qos', UUID('fd7eb6b7-d86c-46da-9cb0-0831a8ed5474')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:01.054732 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfdcf49d7-16, col_values=(('external_ids', {'iface-id': 'fdcf49d7-16fe-42fe-b52c-7dfec239bb0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:62:3d', 'vm-uuid': 'e9fb74e1-48f0-4de0-83ac-500050e65095'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:01.056867 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:01.061169 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:01.062584 np0000001388 nova-compute[98319]: INFO os_vif [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16')
May 26 05:15:01.078671 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:01.082960 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:01.093610 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:01.093610 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:01.100640 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:01.100640 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.109365 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.118570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.122964 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.122964 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.122964 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.122964 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.122964 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:01.123156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.123156 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.123156 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.123156 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.123156 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:01.132587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.132587 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.132587 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.132587 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.132587 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:01.132842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.132842 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.132842 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.132842 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.132842 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:01.157518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260]
May 26 05:15:01.157518 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260] successful.
May 26 05:15:01.157518 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.172358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.181232 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260]
May 26 05:15:01.181232 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260] successful.
May 26 05:15:01.181232 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.190163 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.190427 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:01.190691 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:01.190846 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:01.191820 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('11', '-', '-', 0) found on session 172 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:01.191969 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:01.192507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:01.206721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 172 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:01.206721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.214813 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:01.215444 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:01.215870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:01.216042 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:01.217052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('12', '-', '-', 0) found on session 173 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:01.217222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:01.231982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 173 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:01.231982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:02.051792 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:15:02.582589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:02.582589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:02.582773 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:25:62:3d, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:15:02.583111 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Using config drive
May 26 05:15:02.644760 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:03.070923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found WWN 3300000009d456d1a for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:15:03.071393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:03.071609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== connect_volume: return (5148ms) {'type': 'block', 'scsi_wwn': '3300000009d456d1a', 'path': '/dev/dm-4', 'multipath_id': '3300000009d456d1a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:03.071815 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d456d1a', 'path': '/dev/dm-4', 'multipath_id': '3300000009d456d1a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:15:03.074583 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:03.088298 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:03.219017 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Creating config drive at /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/disk.config
May 26 05:15:03.223354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzn3z6lwi {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:03.279820 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpzn3z6lwi" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:03.579360 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attempting to attach volume 83ab3638-64c8-40e5-b87f-5006c6648a82 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:15:03.581014 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:   <alias name="ua-83ab3638-64c8-40e5-b87f-5006c6648a82"/>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:   <serial>83ab3638-64c8-40e5-b87f-5006c6648a82</serial>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]: </disk>
May 26 05:15:03.581014 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:15:03.683652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:03.706311 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:03.881271 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e412f005-4d8a-4c6a-87b7-3c3a2a743757 req-13e31db4-6a0f-45ac-86c6-5599a2c4574a service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:03.881971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e412f005-4d8a-4c6a-87b7-3c3a2a743757 req-13e31db4-6a0f-45ac-86c6-5599a2c4574a service nova] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:03.882339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e412f005-4d8a-4c6a-87b7-3c3a2a743757 req-13e31db4-6a0f-45ac-86c6-5599a2c4574a service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:03.882652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e412f005-4d8a-4c6a-87b7-3c3a2a743757 req-13e31db4-6a0f-45ac-86c6-5599a2c4574a service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:03.882861 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e412f005-4d8a-4c6a-87b7-3c3a2a743757 req-13e31db4-6a0f-45ac-86c6-5599a2c4574a service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Processing event network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:15:03.906976 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.047999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.050684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.053067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.073696 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.074986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:04.582683 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772504.5822835, e9fb74e1-48f0-4de0-83ac-500050e65095 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:04.583256 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:15:04.583411 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] VM Started (Lifecycle Event)
May 26 05:15:04.587536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:15:04.593144 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance spawned successfully.
May 26 05:15:04.593595 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:15:05.086015 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:05.089438 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:15:05.104663 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.104891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.105204 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.105538 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.105816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.106114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:15:05.336437 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:05.336644 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:05.336781 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:05.336910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No VIF found with MAC fa:16:3e:dd:90:8e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:15:05.592271 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:15:05.594155 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772505.5922995, e9fb74e1-48f0-4de0-83ac-500050e65095 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:05.594155 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] VM Paused (Lifecycle Event)
May 26 05:15:05.611605 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Took 8.63 seconds to spawn the instance on the hypervisor.
May 26 05:15:05.611788 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:05.952072 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:05.952640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:05.953536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:05.953536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:05.953536 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] No waiting events found dispatching network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:05.953536 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-1c38940f-43b5-4eb7-a9ae-9b6ec424ed1c req-ac86a1df-8af2-4fd8-a185-624efbfba1a7 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received unexpected event network-vif-plugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c for instance with vm_state active and task_state None.
May 26 05:15:06.058051 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:06.095101 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:06.097129 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772506.0968082, e9fb74e1-48f0-4de0-83ac-500050e65095 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:06.097370 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] VM Resumed (Lifecycle Event)
May 26 05:15:06.120061 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Took 15.68 seconds to build instance.
May 26 05:15:06.599816 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:06.605937 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:15:06.621981 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.191s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:06.912944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-71a0c762-9be3-4e1c-8dd2-d8c3a9fb30be tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.679s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:07.651777 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:07.797512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-changed-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:07.797512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Refreshing instance network info cache due to event network-changed-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:15:07.798087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] Acquiring lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:15:07.798221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] Acquired lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:15:07.798607 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Refreshing network info cache for port fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:15:08.109850 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:08.110096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:08.303965 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:08.616851 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:08.689506 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:08.871218 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updated VIF entry in instance network info cache for port fdcf49d7-16fe-42fe-b52c-7dfec239bb0c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:15:08.871218 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating instance_info_cache with network_info: [{"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:09.373509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a92ba51c-9d55-4645-b223-615a17d89560 req-54f7b21b-75a3-4a30-856e-67eb2f5a3370 service nova] Releasing lock "refresh_cache-e9fb74e1-48f0-4de0-83ac-500050e65095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:15:09.622446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:09.877080 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:09.877545 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing instance network info cache due to event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:15:09.877545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:15:09.877545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:15:09.877857 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:15:10.379911 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:10.747109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:10.747109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:10.747302 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Attaching volume 3f9b3e45-eb2a-495c-a112-fb70a80ded8d to /dev/vdb
May 26 05:15:10.790733 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:10.799970 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:10.808789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:15:10.830700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:10.879726 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:15:10.880224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:15:10.892041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:15:10.892987 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe0e:d315', 'fe80::ccf0:85ff:fedc:a44', 'fe80::fc16:3eff:fea1:6354', 'fe80::dc7e:86ff:feba:3806', 'fe80::fc16:3eff:fedd:908e', 'fe80::cfa:15ff:febe:944a', 'fe80::fc16:3eff:fe25:623d', 'fe80::5ca0:c8ff:fef8:5735'] 
May 26 05:15:10.893143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:15:10.893427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:15:10.893775 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:10.894120 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating existing volume attachment record: 1447cd80-a439-48a2-bb32-22f6cfcbbc21 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:15:10.959399 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updated VIF entry in instance network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:15:10.959729 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:11.061566 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:11.200214 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:11.200429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing instance network info cache due to event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:15:11.200669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:15:11.463404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b9404bd5-6563-4126-9a44-1770f5337546 req-a1137a89-3673-477d-8a35-6f474f511828 service nova] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:15:11.463667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:15:11.463787 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:15:11.481671 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c9da37cb-a08c-4258-b4c3-7575088ef1f5', 'attached_at': '', 'detached_at': '', 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'serial': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:15:11.485083 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:15:11.485570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:11.485794 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:11.486314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:11.486560 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:15:11.501949 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:11.502666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:11.503156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:11.503394 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:11.503992 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:11.504236 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:11.517932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:11.517932 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:11.523066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:11.523066 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:11.532870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d] added
May 26 05:15:11.532870 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:11.532870 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:11.532870 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:11.532870 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:11.532870 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:11.532870 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:11.533073 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:11.533182 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:11.533342 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:11.537643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d] added
May 26 05:15:11.537643 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:11.537643 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:11.537643 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:11.537643 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:11.537643 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:11.537643 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:11.538110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:11.538110 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:11.538262 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:11.966041 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:12.251743 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:12.370524 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updated VIF entry in instance network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:15:12.370828 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:12.533938 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:12.538644 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:12.550036 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:12.550036 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:12.555901 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:12.555901 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.561656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.568442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.579356 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.579577 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.585665 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.585874 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:12.621712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.40.100,3260]
May 26 05:15:12.621712 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.40.100,3260] successful.
May 26 05:15:12.621712 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.638017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.655663 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.50.100,3260]
May 26 05:15:12.655663 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.50.100,3260] successful.
May 26 05:15:12.655663 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.656193 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.656493 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:12.656929 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:12.657074 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:12.658415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('14', '-', '-', 0) found on session 175 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:12.658559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:12.661439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:12.666984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:12.677067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 175 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:12.677067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.688790 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [174] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2d3e8fb0-e5ca-4e2d-ab75-d941bed8de0b (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:12.689096 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:12.689307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.185s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:12.689362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:12.690552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] HCTL ('15', '-', '-', 0) found on session 176 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:12.690773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:12.711893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Searching for a device in session 176 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:12.713904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:12.874357 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f34da082-94dc-49a6-80df-6fc31237677a req-3c42d69d-a2a9-4aa4-828a-aed7fa1cb852 service nova] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:15:13.504706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:15:14.520624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found WWN 3300000008eb99071 for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:15:14.521124 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:14.522044 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000008eb99071', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000008eb99071'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:14.522145 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008eb99071', 'path': '/dev/disk/by-id/os-brick+dev+dm-5', 'multipath_id': '3300000008eb99071'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:15:14.523808 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:15:14.523991 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:15:14.524123 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:15:14.524615 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7d7ac411d1c0>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'c9da37cb-a08c-4258-b4c3-7575088ef1f5', 'attached_at': '', 'detached_at': '', 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'serial': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:15:14.524770 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] os_brick.utils.get_passphrase_from_secret: the secret is not of type passphrase and will be converted using hex representation {{(pid=98319) get_passphrase_from_secret /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:486}}
May 26 05:15:14.524887 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] opening encrypted volume /dev/dm-5 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 26 05:15:14.556480 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 26 05:15:14.556635 np0000001388 nova-compute[98319]: INFO os_brick.encryptors.luks [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] /dev/dm-5 is not a valid LUKS device; formatting device for first use
May 26 05:15:14.556743 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] formatting encrypted volume /dev/dm-5 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 26 05:15:16.071019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:17.662923 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:21.077464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:22.312646 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] opening encrypted volume /dev/dm-5 {{(pid=98319) _open_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:167}}
May 26 05:15:22.664342 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:23.518008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:23.518008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:23.518920 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Rebooting instance
May 26 05:15:23.882585 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:23.882747 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:23.882911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:23.883049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:23.883155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:23.888181 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Terminating instance
May 26 05:15:24.077608 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:15:24.077775 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:15:24.077973 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:15:24.377109 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:24.391116 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:15:24.408733 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.410499 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.424270 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.428235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.443825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.449325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:24.551561 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:24.551942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:24.551942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:24.552034 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:24.552127 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] No waiting events found dispatching network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:24.552248 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8bf3e4-d713-4c90-ac92-675207c34c9d req-1d08233a-fca4-4aba-94ad-b1a66578dca5 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:15:24.580207 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:24.702906 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999728250999851 future=<Future at 0x7d7aa45f4440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:24.703282 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999310597999738 future=<Future at 0x7d7aa45f4440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:24.703420 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999162681999678 future=<Future at 0x7d7aa45f4440 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:24.704876 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Instance destroyed successfully.
May 26 05:15:24.705435 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lazy-loading 'resources' on Instance uuid 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:24.858373 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:24.879824 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Attempting to attach volume 3f9b3e45-eb2a-495c-a112-fb70a80ded8d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:15:24.881077 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:   <alias name="ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d"/>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:   <serial>3f9b3e45-eb2a-495c-a112-fb70a80ded8d</serial>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]: </disk>
May 26 05:15:24.881077 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:15:24.976330 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:25.208578 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-1790156046',display_name='tempest-TestEncryptedCinderVolumes-server-1790156046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-1790156046',id=63,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJiZhn74hZmZZGmG4S7mSYb6YKdl4yDXAQdh4CTwXXgolNDtBFT4yS1mpAzTijY7l9TVlrG3SJ1otLCIz5tlCAKjE1NLgikS9Rto79TwiBb+GEOqNoMX63qUu8qjEZfbQ==',key_name='tempest-TestEncryptedCinderVolumes-363712271',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:44Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71aa9e17bf6d4b99856c025e45c86c48',ramdisk_id='',reservation_id='r-0ai7yt5n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',owner_project_name='tempest-TestEncryptedCinderVolumes-2082837232',owner_user_name='tempest-TestEncryptedCinderVolumes-2082837232-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:14:44Z,user_data=None,user_id='60af843351d74dd9b068b684da8584fc',uuid=5f5b67bf-5b09-4a67-a1da-1a4a544e3d68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:15:25.208809 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converting VIF {"id": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "address": "fa:16:3e:a1:63:54", "network": {"id": "3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-726964618-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "71aa9e17bf6d4b99856c025e45c86c48", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapce9c04f4-7e", "ovs_interfaceid": "ce9c04f4-7e76-455c-9729-d5cbe471c5a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:25.209510 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:25.209863 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:15:25.211745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.211978 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce9c04f4-7e, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:25.213060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.213953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:25.214608 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.215277 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.215398 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f75113d-e663-48f7-aa1d-edd5b7bab408) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:25.215821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.216249 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:25.216558 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:25.218554 np0000001388 nova-compute[98319]: INFO os_vif [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:63:54,bridge_name='br-int',has_traffic_filtering=True,id=ce9c04f4-7e76-455c-9729-d5cbe471c5a4,network=Network(3bf55ed2-20b2-4d76-bb7d-950abe9c6ca7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce9c04f4-7e')
May 26 05:15:25.221371 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:15:25.221731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:25.222009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:25.478074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:15:25.981814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:26.517547 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:26.517753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:26.517852 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:26.517998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] No VIF found with MAC fa:16:3e:0e:d3:15, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:15:26.603713 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:26.603879 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] Acquiring lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:26.604040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:26.604376 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:26.604514 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] No waiting events found dispatching network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:26.604636 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-20a79ebf-3e19-4bb1-891d-5561a6a3d443 req-4bdac65b-d677-4631-a7c7-aa442d19dafc service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-unplugged-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:15:26.675318 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.453s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:26.675666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '68379437-7b89-4a43-a321-d87e8384e751', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:15:26.675832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:26.701372 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsi session list stdout=tcp: [168] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [169] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:26.701662 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '168'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '169'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09', '177')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:15:26.701662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '169')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:26.702719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751', '168')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:26.703549 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4378cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:15:26.703735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:15:26.703962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Flush multipath device 330000000c068b35f {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:15:26.735030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:26.782771 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:26.825587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:15:26.825739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:15:26.826719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:15:26.837024 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:15:26.837222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:15:26.847899 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.877967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 169, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.40.100,3260]
May 26 05:15:26.877967 np0000001388 nova-compute[98319]: Logout of [sid: 169, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.40.100,3260] successful.
May 26 05:15:26.877967 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.897321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.908299 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.937163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 168, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.50.100,3260]
May 26 05:15:26.937163 np0000001388 nova-compute[98319]: Logout of [sid: 168, target: iqn.2023-03.storpool.com:os--volume-68379437-7b89-4a43-a321-d87e8384e751, portal: 192.168.50.100,3260] successful.
May 26 05:15:26.937163 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.953470 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:26.954481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:26.954646 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] <== disconnect_volume: return (1732ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:26.954788 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:15:26.955206 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Deleting instance files /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68_del
May 26 05:15:26.955781 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Deletion of /opt/stack/data/nova/instances/5f5b67bf-5b09-4a67-a1da-1a4a544e3d68_del complete
May 26 05:15:27.007418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.009953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.032100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.032100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.047064 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.052217 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.223448 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:27.223596 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:27.223744 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:27.223871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:27.223983 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:27.224101 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-b0ca2277-7a2a-4342-862a-ba575032dc78 req-9c9d7fac-408a-4785-b14a-93f06870b1cf service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received unexpected event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with vm_state active and task_state reboot_started_hard.
May 26 05:15:27.328140 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999722960999861 future=<Future at 0x7d7aa43485f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:27.329990 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance destroyed successfully.
May 26 05:15:27.330274 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'resources' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:27.462117 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Took 3.07 seconds to destroy the instance on the hypervisor.
May 26 05:15:27.462891 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:15:27.463285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:15:27.463406 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:15:27.463657 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:27.525771 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:27.665349 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.832955 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:51Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:15:26Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:15:27.833168 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:27.833628 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:27.833838 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:15:27.834813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.835085 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbf41252-af, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:27.837005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:27.837543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.839310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:27.839310 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a03f70d-1c60-48db-aac4-1a6e50fb0587) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:27.839942 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:27.841876 np0000001388 nova-compute[98319]: INFO os_vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af')
May 26 05:15:27.845780 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:15:27.846102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:27.846268 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:27.846888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:27.847592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:15:27.847592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:27.874752 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [172] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [173] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:27.875132 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '172'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '173'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09', '177')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:15:27.875132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '172')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:27.876179 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '173')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:27.877053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac431e980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:15:27.877259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:15:27.877617 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flush multipath device 3300000009d456d1a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:15:27.907583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:27.951022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:27.999966 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:15:28.000128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:15:28.000963 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:15:28.011414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:15:28.011859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:15:28.021748 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.049079 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 172, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260]
May 26 05:15:28.049079 np0000001388 nova-compute[98319]: Logout of [sid: 172, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260] successful.
May 26 05:15:28.049079 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.064988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.078048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.078534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d1abf032-16ec-4403-bc11-52f7fa561929 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.331s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:28.111171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 173, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260]
May 26 05:15:28.111171 np0000001388 nova-compute[98319]: Logout of [sid: 173, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260] successful.
May 26 05:15:28.111171 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.125726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.125901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:28.126030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== disconnect_volume: return (279ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:28.126144 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:15:28.131074 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start _get_guest_xml network_info=[{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d3410866-a956-493a-912e-57063f45d5a4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'd3410866-a956-493a-912e-57063f45d5a4'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': None, 'mount_device': '/dev/vdb', 'delete_on_termination': False, 'attachment_id': 'a24d41f5-961c-492c-8eff-0b9115b5cdb5', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, 'status': 'reserved', 'instance': '29995f89-a4e7-4ee1-930b-a74135fa6bfc', 'attached_at': '', 'detached_at': '', 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'serial': '83ab3638-64c8-40e5-b87f-5006c6648a82'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:15:28.133716 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:15:28.135810 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='d3410866-a956-493a-912e-57063f45d5a4', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-956764858', uuid='29995f89-a4e7-4ee1-930b-a74135fa6bfc'), owner=OwnerMeta(userid='b515a0ad4e5e46bdb9b8ef1590088c49', username='tempest-TestMinimumBasicScenario-2112472404-project-member', projectid='a2daf4310913422fa7ec23fe1a468a39', projectname='tempest-TestMinimumBasicScenario-2112472404'), image=ImageMeta(id='d3410866-a956-493a-912e-57063f45d5a4', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772528.135455) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:15:28.137122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:15:28.137488 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:15:28.138298 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:15:28.138525 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:15:28.139624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:15:28.139911 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d3410866-a956-493a-912e-57063f45d5a4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:15:28.140059 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:15:28.140153 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:15:28.140289 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:15:28.140438 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:15:28.140501 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:15:28.140642 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:15:28.140741 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:15:28.140839 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:15:28.140945 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:15:28.141053 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:15:28.141183 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'vcpu_model' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:28.391129 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:28.643185 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Object Instance<29995f89-a4e7-4ee1-930b-a74135fa6bfc> lazy-loaded attributes: resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:15:28.652815 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:28.749906 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:28.750414 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:28.750697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:28.751330 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:28.751772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:15:28.752178 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:28.752382 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:28.752706 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:28.752967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:15:28.766274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:28.767260 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:28.767826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:28.768082 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:28.768612 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:28.769083 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:28.779206 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:28.779206 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.784522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:15:28.784522 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.790260 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82] added
May 26 05:15:28.790260 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:28.790260 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:28.790260 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:28.790260 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:28.790260 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:28.790260 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.790548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:28.790614 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0225(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:28.790788 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:28.793609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82] added
May 26 05:15:28.793609 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:15:28.793609 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:28.793609 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:28.793609 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:15:28.793609 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:15:28.793609 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:28.793837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:15:28.794110 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:15:28.794340 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:15:28.893689 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Took 1.43 seconds to deallocate network for instance.
May 26 05:15:28.943072 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:28.943322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:29.283725 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:29.284340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:29.284488 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:29.284643 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:29.284808 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:29.284942 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received unexpected event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with vm_state active and task_state reboot_started_hard.
May 26 05:15:29.285079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d0acc436-9dab-498d-9684-60381624cceb req-4c0bc404-8d4b-4d4b-adb0-4b51cd089519 service nova] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Received event network-vif-deleted-ce9c04f4-7e76-455c-9729-d5cbe471c5a4 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:29.444686 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:15:29.446975 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Detaching volume 3f9b3e45-eb2a-495c-a112-fb70a80ded8d
May 26 05:15:29.493752 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Attempting to driver detach volume 3f9b3e45-eb2a-495c-a112-fb70a80ded8d from mountpoint /dev/vdb
May 26 05:15:29.525138 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks2'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'c9da37cb-a08c-4258-b4c3-7575088ef1f5', 'attached_at': '', 'detached_at': '', 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'serial': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:15:29.528734 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:15:29.529818 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Found disk vdb by alias ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:15:29.531220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Attempting to detach device vdb from instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:15:29.531220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <alias name="ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d"/>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <serial>3f9b3e45-eb2a-495c-a112-fb70a80ded8d</serial>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]: </disk>
May 26 05:15:29.531220 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:15:29.535704 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 from the persistent domain config.
May 26 05:15:29.535888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] (1/8): Attempting to detach device vdb with device alias ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d from instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:15:29.536109 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <alias name="ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d"/>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-5"/>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <serial>3f9b3e45-eb2a-495c-a112-fb70a80ded8d</serial>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]: </disk>
May 26 05:15:29.536109 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:15:29.791244 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:15:29.797024 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:29.802893 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:29.802893 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:15:29.807845 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:15:29.807845 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.816660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.822878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.830061 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.830061 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.830061 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.830061 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.830061 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.830061 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:29.830260 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.830260 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.830260 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.830260 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.830260 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.830260 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:29.839265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.839265 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.839265 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.839265 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.839265 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.839265 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:29.839522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.839522 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.839522 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.839522 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.839522 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.839522 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:29.866712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260]
May 26 05:15:29.866712 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260] successful.
May 26 05:15:29.866712 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.878735 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.891058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260]
May 26 05:15:29.891058 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260] successful.
May 26 05:15:29.891058 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.897286 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.897581 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:29.897816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.130s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:29.897906 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:29.898703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('7', '-', '-', 0) found on session 178 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:29.898839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:29.902559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:29.913046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 178 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:29.913046 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.918660 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:29.918894 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:29.919156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:29.919335 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:15:29.923225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('8', '-', '-', 0) found on session 179 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:15:29.923380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:15:29.939495 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 179 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:15:29.939661 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:15:29.952885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:29.952885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:30.013825 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772530.0134528, c9da37cb-a08c-4258-b4c3-7575088ef1f5 => ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:15:30.014039 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-3f9b3e45-eb2a-495c-a112-fb70a80ded8d for instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:15:30.016761 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully detached device vdb from instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 from the live domain config.
May 26 05:15:30.018118 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:15:30.018369 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:15:30.018509 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:15:30.019025 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Using volume encryptor '<os_brick.encryptors.luks.Luks2Encryptor object at 0x7d7ac43a3560>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, 'status': 'reserved', 'instance': 'c9da37cb-a08c-4258-b4c3-7575088ef1f5', 'attached_at': '', 'detached_at': '', 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'serial': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:15:30.019136 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] closing encrypted volume /dev/dm-6 {{(pid=98319) _close_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:207}}
May 26 05:15:30.043835 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:15:30.043835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-5'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:30.043997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:30.211960 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:15:30.212149 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:15:30.714609 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:15:30.768740 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:15:31.220959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.268s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:31.279654 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Deleted allocations for instance 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68
May 26 05:15:31.785584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found WWN 3300000009d456d1a for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:15:31.786058 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:31.786379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000009d456d1a', 'path': '/dev/dm-1', 'multipath_id': '3300000009d456d1a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:31.786512 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009d456d1a', 'path': '/dev/dm-1', 'multipath_id': '3300000009d456d1a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:15:31.786809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.743s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:31.787246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:15:31.787423 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:31.812556 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [175] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [176] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [177] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09 (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:31.812718 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:31.812847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '175'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '176'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7421356b-79af-4dea-b733-0a6eee4a4b09', '177'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '179')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:15:31.812921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '175')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:31.813839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d', '176')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:31.815487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4448360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'): ({'sdj'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:15:31.815487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Removing multipathed devices sdi, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:15:31.815487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Flush multipath device 3300000008eb99071 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:15:31.851514 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:31.907016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:31.946145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if SCSI volumes sdi, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:15:31.946145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] SCSI volumes sdi, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:15:31.946145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Checking to see if device paths {'sdi', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:15:31.958321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Device paths {'sdi', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:15:31.958321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:15:31.968713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:31.998049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 175, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.40.100,3260]
May 26 05:15:31.998049 np0000001388 nova-compute[98319]: Logout of [sid: 175, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.40.100,3260] successful.
May 26 05:15:31.998049 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:32.013236 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:32.024989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:32.056526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 176, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.50.100,3260]
May 26 05:15:32.056526 np0000001388 nova-compute[98319]: Logout of [sid: 176, target: iqn.2023-03.storpool.com:os--volume-3f9b3e45-eb2a-495c-a112-fb70a80ded8d, portal: 192.168.50.100,3260] successful.
May 26 05:15:32.056526 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:32.070781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:32.075251 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:32.075251 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] <== disconnect_volume: return (2028ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:32.075251 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:15:32.290876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f1ea88cc-1066-4c8e-a116-da2a54836202 tempest-TestEncryptedCinderVolumes-2082837232 tempest-TestEncryptedCinderVolumes-2082837232-project-member] Lock "5f5b67bf-5b09-4a67-a1da-1a4a544e3d68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.408s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:32.295135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:51Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:15:26Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:15:32.295322 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:32.295899 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:32.296715 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'pci_devices' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:32.618013 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:32.618565 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:32.620381 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:32.622820 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'flavor' on Instance uuid c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:32.667359 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:32.801384 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Object Instance<29995f89-a4e7-4ee1-930b-a74135fa6bfc> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:15:32.802589 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] End _get_guest_xml xml=<domain type="qemu">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <uuid>29995f89-a4e7-4ee1-930b-a74135fa6bfc</uuid>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <name>instance-00000040</name>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-956764858</nova:name>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:15:28</nova:creationTime>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:image uuid="d3410866-a956-493a-912e-57063f45d5a4">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:user uuid="b515a0ad4e5e46bdb9b8ef1590088c49">tempest-TestMinimumBasicScenario-2112472404-project-member</nova:user>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:project uuid="a2daf4310913422fa7ec23fe1a468a39">tempest-TestMinimumBasicScenario-2112472404</nova:project>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="d3410866-a956-493a-912e-57063f45d5a4"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         <nova:port uuid="dbf41252-af5f-42e2-9f26-3e1da24bad13">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <system>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="serial">29995f89-a4e7-4ee1-930b-a74135fa6bfc</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="uuid">29995f89-a4e7-4ee1-930b-a74135fa6bfc</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </system>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <os>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </os>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <features>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </features>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   <devices>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </disk>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk.config"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </disk>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <alias name="ua-83ab3638-64c8-40e5-b87f-5006c6648a82"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <target dev="vdb" bus="virtio"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <serial>83ab3638-64c8-40e5-b87f-5006c6648a82</serial>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </disk>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:dd:90:8e"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <target dev="tapdbf41252-af"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </interface>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/console.log" append="off"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </serial>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <video>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </video>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </rng>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:   </devices>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]: </domain>
May 26 05:15:32.802589 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:15:32.804812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:32.840822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:32.897613 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:32.897613 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:32.987481 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:32.988067 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:15:32.989113 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'trusted_certs' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:33.491721 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Object Instance<29995f89-a4e7-4ee1-930b-a74135fa6bfc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:15:33.492189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:33.504649 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:33.505610 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:33.575742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1fe234a7343e8baa9db6a1024a8711a89153dedf --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:33.576150 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:15:33.576405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:33.618462 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:33.618932 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:33.619153 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:15:33.619521 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:33.630854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-00d60a35-8fac-43c8-9888-ddd7660fa762 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.687s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:33.662942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:33.663396 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Cannot resize image /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:15:33.663733 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'migration_context' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:34.167396 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Object Instance<29995f89-a4e7-4ee1-930b-a74135fa6bfc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:15:34.168469 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:51Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:15:26Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:15:34.168686 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:34.169383 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:34.169691 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:15:34.170254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.170639 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:34.170959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:15:34.171726 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.171915 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a651cc21-b0a7-5189-8e2b-bddd9dd9cd4a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:34.174299 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:34.175860 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.176059 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbf41252-af, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:34.176429 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbf41252-af, col_values=(('qos', UUID('97b430ec-8839-4652-9307-3c5ae7f76d59')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:34.176607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbf41252-af, col_values=(('external_ids', {'iface-id': 'dbf41252-af5f-42e2-9f26-3e1da24bad13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:90:8e', 'vm-uuid': '29995f89-a4e7-4ee1-930b-a74135fa6bfc'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:34.178959 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:34.183869 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.184772 np0000001388 nova-compute[98319]: INFO os_vif [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af')
May 26 05:15:34.315013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:34.315278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:34.315609 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:34.315760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:34.315901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:34.318475 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Terminating instance
May 26 05:15:34.618640 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:34.619025 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:34.667183 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.692609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.692609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.790644 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.821928 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:15:34.840485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:34.840642 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:34.840788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:34.840935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:34.841057 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:34.841407 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-94c9de96-0987-44e1-b851-617a5c00f0ff req-370d42ba-813f-46d9-8369-d2b4b6c6a0c0 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received unexpected event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with vm_state active and task_state reboot_started_hard.
May 26 05:15:34.846386 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:34.862446 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.046575 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.052557 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.054319 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.078770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.154621 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999728351000158 future=<Future at 0x7d7ac44806e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:35.156493 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Instance destroyed successfully.
May 26 05:15:35.156886 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lazy-loading 'resources' on Instance uuid c9da37cb-a08c-4258-b4c3-7575088ef1f5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:35.176759 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.197048 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.456013 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:15:35.456814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 29995f89-a4e7-4ee1-930b-a74135fa6bfc due to new event <LifecycleEvent: 1779772535.4564333, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:15:35.457125 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772535.4564333, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:35.457368 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Resumed (Lifecycle Event)
May 26 05:15:35.459526 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance rebooted successfully.
May 26 05:15:35.659188 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestEncryptedCinderVolumes-server-163806220',display_name='tempest-TestEncryptedCinderVolumes-server-163806220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testencryptedcindervolumes-server-163806220',id=62,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNXs7DMMnzGhejZAAOeYFwtyesLhbSG5kxZLlIRz466NGYFCCKtM55GjOYqGTHtSawJR5QS9alHtZcK5KbEJvKSlm25tYVPe+6Yr96osma1eq1PRZkMMhkodlIdcLl2w3w==',key_name='tempest-keypair-714923964',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:29Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='495b51ea0c0f4e2f996fbd7a5ccdf223',ramdisk_id='',reservation_id='r-faunubxk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestEncryptedCinderVolumes-2040747730',owner_user_name='tempest-TestEncryptedCinderVolumes-2040747730-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f737dd526dff4402bb2deb8e2fe56f2b',uuid=c9da37cb-a08c-4258-b4c3-7575088ef1f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:15:35.659408 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converting VIF {"id": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "address": "fa:16:3e:0e:d3:15", "network": {"id": "77cc772c-da77-43ad-ab5f-4b0e157849a9", "bridge": "br-int", "label": "tempest-TestEncryptedCinderVolumes-1056286502-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "495b51ea0c0f4e2f996fbd7a5ccdf223", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap50b335ac-22", "ovs_interfaceid": "50b335ac-22a4-4c60-8f0a-dc89b66f23a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:35.659943 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:35.660142 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:15:35.662501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.662615 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50b335ac-22, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:35.663866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.665044 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:35.667119 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.667306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43c2bd61-5489-4540-8e0a-9f2f4c3f3bf8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:35.668342 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:35.669691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:35.671186 np0000001388 nova-compute[98319]: INFO os_vif [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:d3:15,bridge_name='br-int',has_traffic_filtering=True,id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7,network=Network(77cc772c-da77-43ad-ab5f-4b0e157849a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50b335ac-22')
May 26 05:15:35.671651 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Deleting instance files /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5_del
May 26 05:15:35.673909 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Deletion of /opt/stack/data/nova/instances/c9da37cb-a08c-4258-b4c3-7575088ef1f5_del complete
May 26 05:15:35.960107 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:35.963337 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:15:36.178653 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Took 1.36 seconds to destroy the instance on the hypervisor.
May 26 05:15:36.179299 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:15:36.179590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:15:36.179724 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:15:36.180346 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:36.302599 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:36.466059 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 26 05:15:36.466609 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772536.466387, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:36.466813 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Started (Lifecycle Event)
May 26 05:15:36.836486 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4dfc7a47-ae72-418c-b730-8aa6bf07e024 req-f2ab8425-8035-4748-8634-c6acb0bb5b25 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-deleted-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:36.836665 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-4dfc7a47-ae72-418c-b730-8aa6bf07e024 req-f2ab8425-8035-4748-8634-c6acb0bb5b25 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Neutron deleted interface 50b335ac-22a4-4c60-8f0a-dc89b66f23a7; detaching it from the instance and deleting it from the info cache
May 26 05:15:36.836753 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4dfc7a47-ae72-418c-b730-8aa6bf07e024 req-f2ab8425-8035-4748-8634-c6acb0bb5b25 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:36.947655 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:36.947826 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:36.947986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:36.948121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:36.948250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:36.948395 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received unexpected event network-vif-plugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with vm_state active and task_state reboot_started_hard.
May 26 05:15:36.948532 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:36.948641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:36.948913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:36.948913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:36.948991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] No waiting events found dispatching network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:36.949512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:15:36.949624 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:36.949741 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Acquiring lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:36.949863 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:36.949973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:36.950078 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] No waiting events found dispatching network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:36.950176 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-de5940ba-30de-4e37-b7c1-fb59b23d0fbf req-1c6a219a-2969-4e47-9b26-783b872e6963 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Received event network-vif-unplugged-50b335ac-22a4-4c60-8f0a-dc89b66f23a7 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:15:36.969609 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:36.972462 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:36.972594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:36.972677 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:15:36.972764 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No VIF found with MAC fa:16:3e:dd:90:8e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:15:36.973251 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:36.974310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:15:37.247742 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:37.273448 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:37.340374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4dfc7a47-ae72-418c-b730-8aa6bf07e024 req-f2ab8425-8035-4748-8634-c6acb0bb5b25 service nova] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Detach interface failed, port_id=50b335ac-22a4-4c60-8f0a-dc89b66f23a7, reason: Instance c9da37cb-a08c-4258-b4c3-7575088ef1f5 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:15:37.478325 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
May 26 05:15:37.484570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-694be038-0b45-4317-aa2b-3fd6f417676b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 13.967s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:37.617759 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:37.668778 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:37.775788 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Took 1.60 seconds to deallocate network for instance.
May 26 05:15:38.124075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:38.124308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:38.124442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:38.124569 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:15:38.281639 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:38.282054 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:38.472064 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:15:38.472226 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:15:38.976269 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:15:39.146485 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:15:39.150058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:39.257131 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:39.257617 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:39.354423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:39.354899 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:15:39.359087 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:15:39.360464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:15:39.420321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:15:39.420836 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13459MB free_disk=72.69734191894531GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:15:39.421084 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:39.484647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.203s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:39.487786 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.064s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:39.514770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:39.555358 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Deleted allocations for instance c9da37cb-a08c-4258-b4c3-7575088ef1f5
May 26 05:15:39.703098 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00044446800029618316 future=<Future at 0x7d7aa45f4440 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703232 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703342 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.6244999269997606 future=<Future at 0x7d7aa43485f0 state=cancelled>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703425 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=2.6244114219998664 future=<Future at 0x7d7aa43485f0 state=cancelled>) was cancelled while queued, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703460 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703547 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.450763021000057 future=<Future at 0x7d7ac44806e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703617 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.450691005999943 future=<Future at 0x7d7ac44806e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:39.703915 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772524.702519, 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:39.704061 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] VM Stopped (Lifecycle Event)
May 26 05:15:40.207934 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5f5b67bf-5b09-4a67-a1da-1a4a544e3d68] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:40.553730 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:15:40.554072 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e9fb74e1-48f0-4de0-83ac-500050e65095 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:15:40.554072 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:15:40.554138 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:15:39 up 47 min,  2 users,  load average: 4.73, 5.18, 4.64\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_a2daf4310913422fa7ec23fe1a468a39': '1', 'io_workload': '0', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:15:40.564263 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ee7bf2c7-7788-4ec7-abc3-6f5e0cce8886 tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Lock "c9da37cb-a08c-4258-b4c3-7575088ef1f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.249s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:40.668820 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:40.719491 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:15:40.719696 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:15:41.222750 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:15:41.728831 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:15:41.729288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.244s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:41.729288 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:41.729398 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 26 05:15:41.893987 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:42.231316 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:42.670163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:43.141687 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:44.114296 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:44.114654 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:44.115032 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:44.617929 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:44.975221 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:45.119952 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:45.670870 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:46.119883 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:15:46.120064 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 26 05:15:46.621980 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 26 05:15:46.622269 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 24.24 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:15:47.673550 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:48.186048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:48.186306 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:48.186432 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:48.191084 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 26 05:15:48.191710 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'flavor' on Instance uuid e9fb74e1-48f0-4de0-83ac-500050e65095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:48.935353 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.220626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.223804 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.243065 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.246412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.269523 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.275005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.449367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:49.449487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:49.449664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:49.449782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:49.450340 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] No waiting events found dispatching network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:49.450541 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0968ddf3-4eae-4c3f-8714-84ffec9e918c req-4b66675a-5df0-4391-b8de-d0f9e2ed3843 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received unexpected event network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c for instance with vm_state active and task_state powering-off.
May 26 05:15:49.516510 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.528859 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:49.542102 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999582176999866 future=<Future at 0x7d7aa43a9100 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:49.543881 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance destroyed successfully.
May 26 05:15:49.544409 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'numa_topology' on Instance uuid e9fb74e1-48f0-4de0-83ac-500050e65095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:50.048731 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<e9fb74e1-48f0-4de0-83ac-500050e65095> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:15:50.049181 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:50.154865 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004136540001127287 future=<Future at 0x7d7ac44806e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:50.154985 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:50.155031 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.386536464999608 future=<Future at 0x7d7aa43a9100 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:50.155145 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.386430716999712 future=<Future at 0x7d7aa43a9100 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:15:50.155515 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772535.1542535, c9da37cb-a08c-4258-b4c3-7575088ef1f5 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:15:50.155691 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] VM Stopped (Lifecycle Event)
May 26 05:15:50.558170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6441c263-9793-49cd-a543-7a74f7dec796 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.372s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:50.658179 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c9da37cb-a08c-4258-b4c3-7575088ef1f5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:15:50.671850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:50.913622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:51.509778 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:51.514517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:51.514517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:51.514517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:51.514517 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] No waiting events found dispatching network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:15:51.514517 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f5deb480-7b42-4662-af78-add167423f8b req-b2e0eefc-c284-47f3-b89a-2ccfdd6c7d56 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received unexpected event network-vif-unplugged-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c for instance with vm_state stopped and task_state None.
May 26 05:15:52.675259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:53.422586 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:54.359096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:54.359625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:54.359625 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:54.359742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:54.359828 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:15:54.364496 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Terminating instance
May 26 05:15:54.868964 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:15:54.873345 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Instance destroyed successfully.
May 26 05:15:54.873776 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid e9fb74e1-48f0-4de0-83ac-500050e65095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:15:55.180693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.377891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2072935929',display_name='tempest-TestVolumeBootPattern-server-2072935929',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2072935929',id=65,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBCgeCKNxZtqV8TfP0lRr4MRHSxX15otD0IN2i/lRsvJEdEtpxKwdImgCx+JQHjtj5EE93YjXr/AwaR8nH1a0mfAi68BGpYsBrdPInn0t63XmrRmPzcK66W/JX9ybsExGQ==',key_name='tempest-keypair-2081652557',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:15:05Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-3gcn6rka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=e9fb74e1-48f0-4de0-83ac-500050e65095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:15:55.378397 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "address": "fa:16:3e:25:62:3d", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdcf49d7-16", "ovs_interfaceid": "fdcf49d7-16fe-42fe-b52c-7dfec239bb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:15:55.378757 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:15:55.378979 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:15:55.380769 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.380769 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdcf49d7-16, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:55.381570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.382552 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:55.382948 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.383842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.383999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd7eb6b7-d86c-46da-9cb0-0831a8ed5474) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:15:55.384483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.385279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:15:55.385603 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:55.387175 np0000001388 nova-compute[98319]: INFO os_vif [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:62:3d,bridge_name='br-int',has_traffic_filtering=True,id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdcf49d7-16')
May 26 05:15:55.388806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:15:55.389116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:15:55.389343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:15:55.389750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:15:55.390099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '260a117d-7ffb-444e-95b5-6fa415e51a68', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:15:55.390276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:15:55.416029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:55.416029 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:55.416029 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:55.416029 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:55.416029 np0000001388 nova-compute[98319]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c02e6f9-36ab-4804-a12a-23072b0b9fd7 (non-flash)
May 26 05:15:55.416029 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [170] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: tcp: [171] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68 (non-flash)
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: tcp: [180] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-2c02e6f9-36ab-4804-a12a-23072b0b9fd7 (non-flash)
May 26 05:15:55.416414 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:15:55.416414 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '170'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '171'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-2c02e6f9-36ab-4804-a12a-23072b0b9fd7', '180')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:15:55.416710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '171')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:55.417357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68', '170')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:15:55.418287 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46cbce0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:15:55.418518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:15:55.418768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 330000000e92847b7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:15:55.483288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:55.535530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:15:55.587028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:15:55.587191 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:15:55.588025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:15:55.598387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:15:55.598557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:15:55.613311 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.641009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 171, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.40.100,3260]
May 26 05:15:55.641009 np0000001388 nova-compute[98319]: Logout of [sid: 171, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.40.100,3260] successful.
May 26 05:15:55.641009 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.654277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 170, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.50.100,3260]
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: Logout of [sid: 170, target: iqn.2023-03.storpool.com:os--volume-260a117d-7ffb-444e-95b5-6fa415e51a68, portal: 192.168.50.100,3260] successful.
May 26 05:15:55.734775 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (323ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Deleting instance files /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095_del
May 26 05:15:55.734775 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Deletion of /opt/stack/data/nova/instances/e9fb74e1-48f0-4de0-83ac-500050e65095_del complete
May 26 05:15:56.218649 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:15:56.219124 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:15:56.219316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:15:56.219411 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:15:56.219631 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:56.321569 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:15:56.702015 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:56.776496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-17ca90a3-e053-4e26-a867-cb00c65e8467 req-84eeb3b8-074c-4341-a17b-22a0c30c6cb0 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Received event network-vif-deleted-fdcf49d7-16fe-42fe-b52c-7dfec239bb0c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:15:56.776833 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-17ca90a3-e053-4e26-a867-cb00c65e8467 req-84eeb3b8-074c-4341-a17b-22a0c30c6cb0 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Neutron deleted interface fdcf49d7-16fe-42fe-b52c-7dfec239bb0c; detaching it from the instance and deleting it from the info cache
May 26 05:15:56.777011 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-17ca90a3-e053-4e26-a867-cb00c65e8467 req-84eeb3b8-074c-4341-a17b-22a0c30c6cb0 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:57.225733 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:15:57.280845 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-17ca90a3-e053-4e26-a867-cb00c65e8467 req-84eeb3b8-074c-4341-a17b-22a0c30c6cb0 service nova] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Detach interface failed, port_id=fdcf49d7-16fe-42fe-b52c-7dfec239bb0c, reason: Instance e9fb74e1-48f0-4de0-83ac-500050e65095 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:15:57.676967 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:15:57.727483 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Took 1.51 seconds to deallocate network for instance.
May 26 05:15:58.271423 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:15:58.779523 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:15:58.779937 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:15:58.973728 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Refreshing inventories for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 26 05:15:59.016551 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Updating ProviderTree inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 26 05:15:59.016735 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 05:15:59.056898 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Refreshing aggregate associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 26 05:15:59.103631 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Refreshing trait associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, traits: COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 26 05:15:59.242964 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:15:59.243150 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:15:59.746272 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:00.252138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.472s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:00.293729 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance e9fb74e1-48f0-4de0-83ac-500050e65095
May 26 05:16:00.386736 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:01.303476 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e5d9294e-d105-4c15-bfe8-1bf6c49744cb tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "e9fb74e1-48f0-4de0-83ac-500050e65095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.944s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:02.678534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:04.541968 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003579110002647212 future=<Future at 0x7d7aa43a9100 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:04.542417 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:04.542417 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772549.5415, e9fb74e1-48f0-4de0-83ac-500050e65095 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:04.542521 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] VM Stopped (Lifecycle Event)
May 26 05:16:05.044856 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8d7db6ce-9a46-4524-bc0b-9b80245e7c42 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e9fb74e1-48f0-4de0-83ac-500050e65095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:05.387676 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:06.059099 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:06.059493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:06.560967 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:16:07.103749 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:07.104170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:07.106785 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:16:07.106932 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Claim successful on node np0000001388
May 26 05:16:07.363005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:07.363209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:07.679677 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:07.864882 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:16:08.295132 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:08.295603 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:08.413766 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:08.797760 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:09.303998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.200s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:09.304512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:16:09.306768 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.893s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:09.309865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:16:09.309975 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Claim successful on node np0000001388
May 26 05:16:09.810654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:16:09.810918 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:16:09.811126 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:09.811454 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:09.895106 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:16:10.304801 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Successfully created port: e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:16:10.315840 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:16:10.389027 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:10.489485 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:10.489647 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:10.744598 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Successfully updated port: e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:16:10.790589 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-changed-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:10.791040 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Refreshing instance network info cache due to event network-changed-e5a6678a-e931-4cf3-be83-e619f96d9f43. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:10.791040 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] Acquiring lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:10.791147 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] Acquired lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:10.791226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Refreshing network info cache for port e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:10.822485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:16:10.863941 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_power_states {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:10.991989 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:11.246792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:11.293040 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:11.327232 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Booting with volume eabc6170-6aa4-4fad-87c3-962e34a207e6 at /dev/vda
May 26 05:16:11.357578 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:11.368910 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] While synchronizing instance power states, found 3 instances in the database and 1 instances on the hypervisor.
May 26 05:16:11.369214 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:16:11.369530 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:16:11.369765 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Triggering sync for uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) _sync_power_states /opt/stack/nova/nova/compute/manager.py:11194}}
May 26 05:16:11.370247 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:11.371922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:11.372298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:11.372458 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 21.75 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:11.372676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:11.376887 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:11.388590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:16:11.407340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:11.448920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:16:11.449112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:16:11.456856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:16:11.457713 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fedd:908e', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:16:11.457856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:16:11.457956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:16:11.458155 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:11.458378 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating existing volume attachment record: 70ffb422-ded5-4a20-a10e-18470c0c4831 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:16:11.500166 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.193s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:11.500578 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:16:11.511605 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:11.878067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.506s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:12.007541 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:16:12.007926 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:16:12.008427 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:12.008654 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:12.014370 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a74d55b-9318-4bea-8484-f51d8deea0f7 req-1277d8a8-1c70-43e6-9c30-d6cffcfbfb9f service nova] Releasing lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:12.014930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:12.015078 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:16:12.069345 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c37fe18037cb4b90bf4c0a076bddd23a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0f3c957b6c74be39b5af571c5d499a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:16:12.418338 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Successfully created port: 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:16:12.508791 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:16:12.573862 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:12.681764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:12.714906 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:12.840108 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:12.863768 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Successfully updated port: 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:16:12.907657 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:12.907877 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing instance network info cache due to event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:12.908052 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:12.908335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:12.908463 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:13.012653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:16:13.342265 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:13.342590 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance network_info: |[{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:16:13.365754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:13.410135 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:13.473943 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:13.517897 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Booting with volume d437ee4e-4adb-4130-9727-3206d3b322d4 at /dev/vda
May 26 05:16:13.551930 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:16:13.555792 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:16:13.556099 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Creating image(s)
May 26 05:16:13.556597 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:16:13.556759 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Ensure instance console log exists: /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:16:13.561267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:13.562004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:13.562250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:13.562906 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start _get_guest_xml network_info=[{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '70ffb422-ded5-4a20-a10e-18470c0c4831', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '35df698f-2a48-4603-b3a8-9e71b2a47b46', 'attached_at': '', 'detached_at': '', 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'serial': 'eabc6170-6aa4-4fad-87c3-962e34a207e6'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:16:13.569058 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:16:13.570626 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-337625935', uuid='35df698f-2a48-4603-b3a8-9e71b2a47b46'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772573.570119) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:16:13.572277 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:13.577456 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:16:13.577845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:16:13.579020 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:16:13.579245 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:16:13.580727 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:16:13.581440 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:16:13.581440 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:16:13.581440 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:16:13.582928 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:16:13.597344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:16:13.601979 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:16:13.601979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:13.601979 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:13.602939 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:13.603249 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:16:13.618041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:13.618676 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:13.619228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:13.619493 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:13.619923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:13.620139 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:13.634838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:13.634838 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:13.635632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:13.654634 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:13.657788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:13.657788 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:13.658471 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6] added
May 26 05:16:13.658471 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:13.658471 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:13.658471 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:13.658471 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:13.658471 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:13.658471 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:13.658709 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:13.659114 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0394(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:13.659368 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:13.669721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6] added
May 26 05:16:13.669721 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:13.669721 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:13.669721 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:13.669721 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:13.669721 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:13.669721 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:13.669926 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:13.670076 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0499(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:13.670239 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:13.679038 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:16:13.679359 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:16:13.689379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:16:13.690516 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fedd:908e', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:16:13.690719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:16:13.690777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:16:13.691056 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:13.691321 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating existing volume attachment record: 5cec2c06-783c-4cd2-935b-75e1e18230df {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:16:14.160882 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94640bab-d60b-4f5e-9d6c-d38fad45288a req-b400372b-b6b5-4c0b-b258-cbafe259f5e3 service nova] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:14.161381 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:14.161572 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:16:14.660011 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:14.671324 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:14.672451 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:14.672451 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:14.684548 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:14.684548 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.690173 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.697310 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.705895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.705895 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.705895 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:14.706082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.706082 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.706082 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:14.712309 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.712309 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.712309 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:14.712519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.712519 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.712519 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:14.731856 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:14.735057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260]
May 26 05:16:14.735057 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260] successful.
May 26 05:16:14.735057 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.748723 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.758934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260]
May 26 05:16:14.758934 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260] successful.
May 26 05:16:14.758934 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.766970 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.766970 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.766970 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.766970 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.766970 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:14.767548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.767548 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.767548 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.767548 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.767548 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:14.767548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:14.767905 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:14.770060 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 183 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:14.770238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:14.771623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:14.796191 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.796191 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.796191 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.796191 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.796191 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:14.796488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.796488 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:14.796488 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.796488 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:14.796488 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:14.796879 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.177s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:14.797077 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:14.802110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 183 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:14.802561 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:14.803761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 184 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:14.803761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:14.819018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 184 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:14.962814 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:14.993881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:14.994121 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing instance network info cache due to event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:14.994359 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:14.994475 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:14.994577 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:15.114389 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:15.397971 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:15.496854 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:15.616165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:15.616447 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance network_info: |[{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:16:15.752541 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:15.809978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:16:15.811363 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:16:15.812041 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Creating image(s)
May 26 05:16:15.812399 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:16:15.812585 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Ensure instance console log exists: /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:16:15.815974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:15.816151 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:15.816399 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:15.816852 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Start _get_guest_xml network_info=[{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '5cec2c06-783c-4cd2-935b-75e1e18230df', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f', 'attached_at': '', 'detached_at': '', 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'serial': 'd437ee4e-4adb-4130-9727-3206d3b322d4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:16:15.817670 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 184 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:15.817971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:15.821131 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:16:15.822239 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestInstancesWithCinderVolumes-server-240630702', uuid='3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f'), owner=OwnerMeta(userid='c37fe18037cb4b90bf4c0a076bddd23a', username='tempest-TestInstancesWithCinderVolumes-1793421881-project-member', projectid='f0f3c957b6c74be39b5af571c5d499a9', projectname='tempest-TestInstancesWithCinderVolumes-1793421881'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772575.8218746) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:16:15.824125 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:16:15.824523 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:16:15.825350 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:16:15.825672 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:16:15.826757 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:16:15.827104 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:16:15.827292 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:16:15.827427 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:16:15.827599 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:16:15.827715 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:16:15.827864 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:16:15.828043 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:16:15.828172 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:16:15.828363 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:16:15.828513 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:16:15.828655 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:16:15.842712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:16:15.843019 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:15.843208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:15.881653 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updated VIF entry in instance network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:16:15.881901 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:15.910495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:15.910682 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing instance network info cache due to event network-changed-dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:15.910788 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] Acquiring lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:16.383724 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3505868f-efff-424e-8f5c-78cbf6658d72 req-bed9c871-6228-4894-a27c-2f48dee049d5 service nova] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:16.384011 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] Acquired lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:16.384161 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Refreshing network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:16.491305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:16.491520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:16.636604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 330000000447904b7 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:16:16.636870 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:16.637051 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000447904b7', 'path': '/dev/dm-0', 'multipath_id': '330000000447904b7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:16.637150 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000447904b7', 'path': '/dev/dm-0', 'multipath_id': '330000000447904b7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:16:16.637574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.794s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:16.637838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:16:16.650890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:16.651446 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:16.651774 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:16.651929 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:16.652185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:16.652385 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:16.661715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:16.661715 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:16.666247 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:16.666247 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:16.673253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4] added
May 26 05:16:16.673253 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:16.673253 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:16.673253 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:16.673253 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:16.673253 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:16.673253 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:16.673521 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:16.673638 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0212(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:16.673809 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:16.677208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4] added
May 26 05:16:16.677208 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:16.677208 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:16.677208 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:16.677208 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:16.677208 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:16.677208 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:16.677427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:16.677523 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0256(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:16.677668 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:16.886264 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:16.993891 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Detaching volume 83ab3638-64c8-40e5-b87f-5006c6648a82
May 26 05:16:17.031324 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Attempting to driver detach volume 83ab3638-64c8-40e5-b87f-5006c6648a82 from mountpoint /dev/vdb
May 26 05:16:17.034730 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found disk vdb by alias ua-83ab3638-64c8-40e5-b87f-5006c6648a82 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:16:17.036293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found disk vdb by alias ua-83ab3638-64c8-40e5-b87f-5006c6648a82 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:16:17.036293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Attempting to detach device vdb from instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:16:17.036293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <alias name="ua-83ab3638-64c8-40e5-b87f-5006c6648a82"/>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <serial>83ab3638-64c8-40e5-b87f-5006c6648a82</serial>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]: </disk>
May 26 05:16:17.036293 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:16:17.043706 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully detached device vdb from instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc from the persistent domain config.
May 26 05:16:17.044079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] (1/8): Attempting to detach device vdb with device alias ua-83ab3638-64c8-40e5-b87f-5006c6648a82 from instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:16:17.044400 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <alias name="ua-83ab3638-64c8-40e5-b87f-5006c6648a82"/>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <serial>83ab3638-64c8-40e5-b87f-5006c6648a82</serial>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]: </disk>
May 26 05:16:17.044400 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:16:17.130773 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:17.142235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:16:17.142547 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:17.143051 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:17.143751 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:17.264972 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updated VIF entry in instance network info cache for port dbf41252-af5f-42e2-9f26-3e1da24bad13. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:16:17.265147 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [{"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:17.600219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772577.599888, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => ua-83ab3638-64c8-40e5-b87f-5006c6648a82> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:16:17.601529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-83ab3638-64c8-40e5-b87f-5006c6648a82 for instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:16:17.604407 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully detached device vdb from instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc from the live domain config.
May 26 05:16:17.605573 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:16:17.605934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:17.606108 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:17.646835 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] End _get_guest_xml xml=<domain type="qemu">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <uuid>35df698f-2a48-4603-b3a8-9e71b2a47b46</uuid>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <name>instance-00000042</name>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-337625935</nova:name>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:16:13</nova:creationTime>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         <nova:port uuid="e5a6678a-e931-4cf3-be83-e619f96d9f43">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <system>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="serial">35df698f-2a48-4603-b3a8-9e71b2a47b46</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="uuid">35df698f-2a48-4603-b3a8-9e71b2a47b46</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </system>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <os>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </os>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <features>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </features>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   <devices>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <alias name="ua-eabc6170-6aa4-4fad-87c3-962e34a207e6"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <serial>eabc6170-6aa4-4fad-87c3-962e34a207e6</serial>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:62:de:92"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <target dev="tape5a6678a-e9"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </interface>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/console.log" append="off"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </serial>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <video>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </video>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </rng>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:   </devices>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]: </domain>
May 26 05:16:17.646835 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Preparing to wait for external event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:16:17.649070 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:17.649519 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:17.649849 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:16:17.650386 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.650727 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:17.651083 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:16:17.651814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.651996 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd6edb0e-cc59-5d97-a874-8e6da9aa632a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:17.653520 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.654078 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:17.655938 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.656071 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5a6678a-e9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:17.656388 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5a6678a-e9, col_values=(('qos', UUID('590053d3-9f83-4f75-b63b-f5f9da998ff7')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:17.656553 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5a6678a-e9, col_values=(('external_ids', {'iface-id': 'e5a6678a-e931-4cf3-be83-e619f96d9f43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:de:92', 'vm-uuid': '35df698f-2a48-4603-b3a8-9e71b2a47b46'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:17.658613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:17.662609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.663620 np0000001388 nova-compute[98319]: INFO os_vif [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9')
May 26 05:16:17.674249 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:17.678274 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:17.681718 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:17.685881 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:17.685881 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:17.692715 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:17.692715 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.698832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.706087 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.712327 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.712327 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.712327 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.712327 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.712327 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:17.712563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.712563 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.712563 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.712563 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.712563 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:17.718602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.718602 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.718602 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.718602 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.718602 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:17.718810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.718810 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.718810 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.718810 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.718810 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:17.752064 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.50.100,3260]
May 26 05:16:17.752064 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.50.100,3260] successful.
May 26 05:16:17.752064 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.752628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.40.100,3260]
May 26 05:16:17.752628 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.40.100,3260] successful.
May 26 05:16:17.752628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.764476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.766813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ffe7a77b-ca3e-41f1-81e4-a466aa68d085 req-5cc2c338-e8a7-4e32-a54e-6bdcdf220db5 service nova] Releasing lock "refresh_cache-29995f89-a4e7-4ee1-930b-a74135fa6bfc" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:17.768796 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.780478 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.780803 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:17.780803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.129s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:17.781084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:17.781586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('11', '-', '-', 0) found on session 185 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:17.781703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.782400 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:17.782624 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:17.782864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.131s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:17.783163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:17.783840 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('12', '-', '-', 0) found on session 186 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:17.783948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:17.809812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 185 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:17.809812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:17.809812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 186 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:17.809812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:18.653416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:16:19.178546 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:19.178702 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:19.178767 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:62:de:92, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:16:19.179167 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Using config drive
May 26 05:16:19.668911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found WWN 33000000018bb6d33 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:16:19.669329 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:19.669589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== connect_volume: return (3825ms) {'type': 'block', 'scsi_wwn': '33000000018bb6d33', 'path': '/dev/dm-4', 'multipath_id': '33000000018bb6d33'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:19.669799 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000018bb6d33', 'path': '/dev/dm-4', 'multipath_id': '33000000018bb6d33'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:16:19.670451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.064s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:19.670944 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '83ab3638-64c8-40e5-b87f-5006c6648a82', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:16:19.671226 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:16:19.684598 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:19.704049 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [178] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: tcp: [179] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:19.704312 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:19.704499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '178'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '179'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:16:19.704689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '178')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:16:19.705859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82', '179')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:16:19.706998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa45922a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:16:19.707627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:16:19.707940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flush multipath device 3300000009d456d1a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:16:19.739671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:16:19.782960 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:16:19.828020 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Creating config drive at /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config
May 26 05:16:19.828597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:16:19.828827 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:16:19.831149 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:16:19.834169 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphwphdffa {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:19.846847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:16:19.847377 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:16:19.862360 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.892086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphwphdffa" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:19.900489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 178, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260]
May 26 05:16:19.900489 np0000001388 nova-compute[98319]: Logout of [sid: 178, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.40.100,3260] successful.
May 26 05:16:19.900489 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.919876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.930623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.965639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 179, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260]
May 26 05:16:19.965639 np0000001388 nova-compute[98319]: Logout of [sid: 179, target: iqn.2023-03.storpool.com:os--volume-83ab3638-64c8-40e5-b87f-5006c6648a82, portal: 192.168.50.100,3260] successful.
May 26 05:16:19.965639 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.983161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:19.983518 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:19.983656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== disconnect_volume: return (2378ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:19.983803 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:16:20.176355 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-240630702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testinstanceswithcindervolumes-server-240630702',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsgPtOUd9911qY9Z6IMvNRZKeUAYXhrc5TyK0vkhboy+gLi2vxYZMpovPQJDPh5u3AkemeYWxxmo5HWPkU+o/GDPRQnRbGc+75rygDEhZOqnX18IqH0KedM1ZshdUn9mQ==',key_name='tempest-TestInstancesWithCinderVolumes-903301612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f3c957b6c74be39b5af571c5d499a9',ramdisk_id='',reservation_id='r-c3ym0x9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1793421881',owner_user_name='tempest-TestInstancesWithCinderVolumes-1793421881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:13Z,user_data=None,user_id='c37fe18037cb4b90bf4c0a076bddd23a',uuid=3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:16:20.176595 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converting VIF {"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:20.177245 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:20.177937 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:20.279612 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.302898 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.411066 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.461398 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d4f5e785-904f-4923-96c8-14ba23f036e6 req-c986739d-7275-4e20-80b7-ded064460295 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:20.461674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4f5e785-904f-4923-96c8-14ba23f036e6 req-c986739d-7275-4e20-80b7-ded064460295 service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:20.461888 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4f5e785-904f-4923-96c8-14ba23f036e6 req-c986739d-7275-4e20-80b7-ded064460295 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:20.462058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d4f5e785-904f-4923-96c8-14ba23f036e6 req-c986739d-7275-4e20-80b7-ded064460295 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:20.462259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d4f5e785-904f-4923-96c8-14ba23f036e6 req-c986739d-7275-4e20-80b7-ded064460295 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Processing event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:16:20.534685 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:20.620555 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.624369 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.646554 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.681612 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] End _get_guest_xml xml=<domain type="qemu">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <uuid>3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f</uuid>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <name>instance-00000043</name>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestInstancesWithCinderVolumes-server-240630702</nova:name>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:16:15</nova:creationTime>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:user uuid="c37fe18037cb4b90bf4c0a076bddd23a">tempest-TestInstancesWithCinderVolumes-1793421881-project-member</nova:user>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:project uuid="f0f3c957b6c74be39b5af571c5d499a9">tempest-TestInstancesWithCinderVolumes-1793421881</nova:project>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         <nova:port uuid="37f81a2d-6d2e-449e-a088-c1c24222a07a">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.13" ipVersion="4"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <system>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="serial">3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="uuid">3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </system>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <os>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </os>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <features>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </features>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   <devices>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/disk.config"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <alias name="ua-d437ee4e-4adb-4130-9727-3206d3b322d4"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <serial>d437ee4e-4adb-4130-9727-3206d3b322d4</serial>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:2c:7d:6e"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <target dev="tap37f81a2d-6d"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </interface>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/console.log" append="off"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </serial>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <video>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </video>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </rng>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:   </devices>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]: </domain>
May 26 05:16:20.681612 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Preparing to wait for external event network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-240630702',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testinstanceswithcindervolumes-server-240630702',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsgPtOUd9911qY9Z6IMvNRZKeUAYXhrc5TyK0vkhboy+gLi2vxYZMpovPQJDPh5u3AkemeYWxxmo5HWPkU+o/GDPRQnRbGc+75rygDEhZOqnX18IqH0KedM1ZshdUn9mQ==',key_name='tempest-TestInstancesWithCinderVolumes-903301612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f0f3c957b6c74be39b5af571c5d499a9',ramdisk_id='',reservation_id='r-c3ym0x9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-TestInstancesWithCinderVolumes-1793421881',owner_user_name='tempest-TestInstancesWithCinderVolumes-1793421881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:13Z,user_data=None,user_id='c37fe18037cb4b90bf4c0a076bddd23a',uuid=3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:16:20.683822 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converting VIF {"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:20.684121 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:20.684269 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:16:20.684993 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.685342 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:20.685703 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:16:20.686480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.686707 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '85754827-e3e6-5196-b5ff-48d7580d6744', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:20.688232 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.688783 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.691570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.691810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37f81a2d-6d, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:20.692316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap37f81a2d-6d, col_values=(('qos', UUID('d4a965bd-484b-4205-ba54-b44cd32b76f6')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:20.692586 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap37f81a2d-6d, col_values=(('external_ids', {'iface-id': '37f81a2d-6d2e-449e-a088-c1c24222a07a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2c:7d:6e', 'vm-uuid': '3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:20.693597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.695137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:20.699564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:20.700431 np0000001388 nova-compute[98319]: INFO os_vif [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d')
May 26 05:16:21.092600 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772581.0921514, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:21.092757 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Started (Lifecycle Event)
May 26 05:16:21.093776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:16:21.097845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:16:21.100083 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance spawned successfully.
May 26 05:16:21.100517 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:16:21.541898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d07b2ea3-b67b-4193-8977-c6c791daa37c tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:21.596680 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:21.598304 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:21.608971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:21.609151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:21.609505 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:21.610175 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:21.610637 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:21.610943 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:22.100941 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:16:22.101363 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772582.1010706, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:22.101549 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Paused (Lifecycle Event)
May 26 05:16:22.116489 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Took 8.56 seconds to spawn the instance on the hypervisor.
May 26 05:16:22.116773 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:22.220831 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:22.220977 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:22.221602 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No VIF found with MAC fa:16:3e:2c:7d:6e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:16:22.221602 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Using config drive
May 26 05:16:22.532478 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:22.532913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:22.532967 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:22.533111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:22.533285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:16:22.533435 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-f902527f-5697-4cb0-a1c8-6eb72bd59681 req-c9c73ce9-bd04-4e0f-a4c6-a629212bb57a service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received unexpected event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with vm_state active and task_state None.
May 26 05:16:22.604746 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:22.606366 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772582.6061916, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:22.606462 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Resumed (Lifecycle Event)
May 26 05:16:22.625397 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Took 15.56 seconds to build instance.
May 26 05:16:22.683492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:22.726994 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:22.859257 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Creating config drive at /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/disk.config
May 26 05:16:22.862218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazp8yi4x {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:22.899714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:22.899714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:22.899714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:22.899714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:22.899714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:22.904182 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Terminating instance
May 26 05:16:22.919787 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpazp8yi4x" returned: 0 in 0.057s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:23.108948 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:23.114675 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:23.127365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.068s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:23.127725 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.757s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:23.128266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
May 26 05:16:23.128266 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:23.366318 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.394551 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.395527 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.409002 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:16:23.431137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.435024 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.454076 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.516379 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.644550 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7ecfe23-34e0-489e-bfd5-bd31ce212319 req-8898bc4b-c314-40e1-9ed1-2419c5957456 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:23.644550 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7ecfe23-34e0-489e-bfd5-bd31ce212319 req-8898bc4b-c314-40e1-9ed1-2419c5957456 service nova] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:23.644861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7ecfe23-34e0-489e-bfd5-bd31ce212319 req-8898bc4b-c314-40e1-9ed1-2419c5957456 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:23.645025 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d7ecfe23-34e0-489e-bfd5-bd31ce212319 req-8898bc4b-c314-40e1-9ed1-2419c5957456 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:23.645953 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d7ecfe23-34e0-489e-bfd5-bd31ce212319 req-8898bc4b-c314-40e1-9ed1-2419c5957456 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Processing event network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:16:23.751538 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999692014000175 future=<Future at 0x7d7aeda09c40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:23.755288 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997279835999962 future=<Future at 0x7d7aeda09c40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:23.755288 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997022254000058 future=<Future at 0x7d7aeda09c40 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:23.759848 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Instance destroyed successfully.
May 26 05:16:23.760441 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'resources' on Instance uuid 29995f89-a4e7-4ee1-930b-a74135fa6bfc {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:23.805739 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.813370 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.817882 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.839376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.846372 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.948843 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:23.983256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.263395 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:14:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-956764858',display_name='tempest-TestMinimumBasicScenario-server-956764858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-956764858',id=64,image_ref='d3410866-a956-493a-912e-57063f45d5a4',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO8zla2T/yHHsUiSRXmguXvZ8G5lI+vWfKvMg7bpdBYl/M3qripGdhPomkHs9HwHggqlhx1bcqXvnbfaTjFaz4wP5eTLECO+aDXpfQlQwrc3p3jPHxFblb+pSCgMlKIA1A==',key_name='tempest-TestMinimumBasicScenario-651916461',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:14:51Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-zlt6jsro',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d3410866-a956-493a-912e-57063f45d5a4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:15:37Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=29995f89-a4e7-4ee1-930b-a74135fa6bfc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:16:24.263758 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "address": "fa:16:3e:dd:90:8e", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbf41252-af", "ovs_interfaceid": "dbf41252-af5f-42e2-9f26-3e1da24bad13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:24.264283 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:24.264545 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:16:24.266048 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.266360 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbf41252-af, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:24.267294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.268022 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:24.268621 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.269325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.269501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97b430ec-8839-4652-9307-3c5ae7f76d59) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:24.269953 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.270422 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:24.270650 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:24.272399 np0000001388 nova-compute[98319]: INFO os_vif [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:90:8e,bridge_name='br-int',has_traffic_filtering=True,id=dbf41252-af5f-42e2-9f26-3e1da24bad13,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbf41252-af')
May 26 05:16:24.272701 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Deleting instance files /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc_del
May 26 05:16:24.273433 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Deletion of /opt/stack/data/nova/instances/29995f89-a4e7-4ee1-930b-a74135fa6bfc_del complete
May 26 05:16:24.281594 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772584.2811248, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:24.282078 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:16:24.282300 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] VM Started (Lifecycle Event)
May 26 05:16:24.285213 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:16:24.287394 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance spawned successfully.
May 26 05:16:24.287715 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:16:24.596641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-changed-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:24.599814 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Refreshing instance network info cache due to event network-changed-e5a6678a-e931-4cf3-be83-e619f96d9f43. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:24.600093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] Acquiring lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:24.600289 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] Acquired lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:24.600518 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Refreshing network info cache for port e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:24.779052 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Took 1.37 seconds to destroy the instance on the hypervisor.
May 26 05:16:24.779686 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:16:24.779848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:16:24.779934 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:16:24.780215 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:24.784440 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:24.786439 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:24.795315 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.795473 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.795703 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.795891 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.796076 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.796278 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:24.857908 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:25.103043 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:25.289716 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:16:25.290267 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772585.2898064, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:25.290267 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] VM Paused (Lifecycle Event)
May 26 05:16:25.301024 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Took 9.49 seconds to spawn the instance on the hypervisor.
May 26 05:16:25.301253 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:25.436524 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:25.598930 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updated VIF entry in instance network info cache for port e5a6678a-e931-4cf3-be83-e619f96d9f43. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:16:25.599387 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:25.607662 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:25.701386 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:25.701902 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:25.702080 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:25.702210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:25.702366 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] No waiting events found dispatching network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:16:25.702516 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received unexpected event network-vif-plugged-37f81a2d-6d2e-449e-a088-c1c24222a07a for instance with vm_state active and task_state None.
May 26 05:16:25.702641 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:25.702792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:25.703009 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:25.703111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:25.703230 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:16:25.703374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:16:25.703511 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:25.703696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Acquiring lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:25.703855 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:25.703959 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:25.704063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] No waiting events found dispatching network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:16:25.704277 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31412f06-e42c-48f3-91e5-113ec89295e4 req-b4ff21c1-665b-4802-867c-7393b9c2b465 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-unplugged-dbf41252-af5f-42e2-9f26-3e1da24bad13 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:16:25.792505 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:25.794564 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772585.7943273, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:25.794695 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] VM Resumed (Lifecycle Event)
May 26 05:16:25.814647 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Took 17.45 seconds to build instance.
May 26 05:16:26.101760 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f771cce5-b2b0-48f0-9f17-337ad97a351f req-421580e0-8fcd-49eb-92d1-c222d313ada8 service nova] Releasing lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:26.109266 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Took 1.33 seconds to deallocate network for instance.
May 26 05:16:26.296736 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:26.298506 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:26.316074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b47f1f8f-1df7-4c01-b89b-10ad48bf462f tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.953s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:26.316583 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.946s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:26.614876 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:26.615043 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:26.647433 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e7039cf3-92ea-4ae3-9acf-e321e1ef4e25 req-0ebca197-20ba-428c-b0c8-52208711c476 service nova] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Received event network-vif-deleted-dbf41252-af5f-42e2-9f26-3e1da24bad13 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:26.821112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.504s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:26.822578 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:26.822921 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:27.008656 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:27.009427 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing instance network info cache due to event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:27.009427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:27.009427 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:27.009427 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:27.328394 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:27.511045 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:27.686786 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:27.803639 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:27.834668 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.220s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:27.902692 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Deleted allocations for instance 29995f89-a4e7-4ee1-930b-a74135fa6bfc
May 26 05:16:27.947144 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updated VIF entry in instance network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:16:27.947431 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:28.449214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-edc8b724-e232-41e1-af7f-8a917cb9e23f req-436f28c0-1042-457b-a9f4-3bcfeda8b58c service nova] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:28.699133 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:28.699250 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing instance network info cache due to event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:28.699421 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:28.699497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:28.699626 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:28.916254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-269ff0db-16bd-45ec-83ae-74960beb03cc tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "29995f89-a4e7-4ee1-930b-a74135fa6bfc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.017s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:29.201429 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:29.282362 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:29.476995 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:29.596191 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updated VIF entry in instance network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:16:29.596615 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:30.098728 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98c2986b-ba64-4f5d-92fc-f2898e224ad3 req-bdd59a21-3134-4125-8d54-79906e755bfb service nova] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:32.461894 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:32.462239 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:32.688211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:32.965310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:16:33.126757 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:33.127016 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:33.127306 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.49 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:33.641836 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:33.642277 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.86 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:33.706424 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:33.706424 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:33.708842 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:16:33.708950 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Claim successful on node np0000001388
May 26 05:16:34.283494 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:34.501001 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:34.501321 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:34.617693 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:34.617844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:16:34.618117 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:34.879985 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:34.880659 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:35.382611 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:35.888909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.183s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:35.889405 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:16:36.395595 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:16:36.395754 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:16:36.396012 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:36.396206 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:36.470918 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b515a0ad4e5e46bdb9b8ef1590088c49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2daf4310913422fa7ec23fe1a468a39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:16:36.618116 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:36.618447 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:36.882590 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Successfully created port: 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:16:36.898574 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:16:37.349479 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Successfully updated port: 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:16:37.401912 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:16:37.410366 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:37.413696 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing instance network info cache due to event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:37.413696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:37.414075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:37.414232 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:37.618051 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:37.689009 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:37.851758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:37.917866 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:37.982060 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:38.097540 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:38.121935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:38.122098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:38.122191 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:38.122377 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:16:38.409696 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:16:38.410531 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:16:38.410752 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Creating image(s)
May 26 05:16:38.411087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:38.411234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:38.411796 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:38.412042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:38.412364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:38.600813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-753f6fa1-ea0b-4a1f-83f0-8d7111bf0c6a req-ea26b58c-8a54-4ce8-b50d-adb0b7f4944e service nova] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:38.601126 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:38.601268 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:16:38.751622 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00046280300011858344 future=<Future at 0x7d7aeda09c40 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:38.751775 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:16:38.752118 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] Emitting event <LifecycleEvent: 1779772583.751068, 29995f89-a4e7-4ee1-930b-a74135fa6bfc => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:38.752319 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] VM Stopped (Lifecycle Event)
May 26 05:16:38.948548 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:38.952417 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:38.952840 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.part --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.049284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.part --force-share --output=json" returned: 0 in 0.096s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.049853 np0000001388 nova-compute[98319]: DEBUG nova.virt.images [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] 252cbd3e-9981-49e2-9887-d01f71609b05 was qcow2, converting to raw {{(pid=98319) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}}
May 26 05:16:39.050508 np0000001388 nova-compute[98319]: DEBUG nova.privsep.utils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98319) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
May 26 05:16:39.050792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.part /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.converted {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.146326 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:16:39.147457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:16:39.148982 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:16:39.149867 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.168469 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:16:39.196100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.046s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.196558 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13628MB free_disk=72.69507598876953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:16:39.196773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:39.197082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:39.206598 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.part /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.converted" returned: 0 in 0.156s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.212801 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.converted --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.255762 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-3fca1ae1-d230-4447-b93e-9fb77957022d tempest-AttachVolumeMultiAttachTest-2062276086 tempest-AttachVolumeMultiAttachTest-2062276086-project-member] [instance: 29995f89-a4e7-4ee1-930b-a74135fa6bfc] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:39.284592 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:39.297238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df.converted --force-share --output=json" returned: 0 in 0.084s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.297813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.885s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:39.298337 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:39.301505 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:39.304149 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.338642 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:39.391464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.391877 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:39.392360 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:39.392813 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:39.395352 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:16:39.395633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.474770 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:16:39.485073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.485778 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df,backing_fmt=raw /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.538444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df,backing_fmt=raw /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk 1073741824" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.540109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "05a7123cd7c1c637de10a4d234d62aef2643e2df" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:39.540400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.631224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05a7123cd7c1c637de10a4d234d62aef2643e2df --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.631662 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking if we can resize image /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:16:39.631926 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:39.717365 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:39.717727 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Cannot resize image /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:16:39.718044 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:16:39.718610 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Ensure instance console log exists: /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:16:39.719094 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:39.719340 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:39.719499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:39.977490 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:16:39.977902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance network_info: |[{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:16:39.979590 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Start _get_guest_xml network_info=[{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T05:16:30Z,direct_url=<?>,disk_format='qcow2',id=252cbd3e-9981-49e2-9887-d01f71609b05,min_disk=0,min_ram=0,name='tempest-scenario-img--54115541',owner='a2daf4310913422fa7ec23fe1a468a39',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T05:16:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': '252cbd3e-9981-49e2-9887-d01f71609b05'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:16:39.982944 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:16:39.984156 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='252cbd3e-9981-49e2-9887-d01f71609b05', instance_meta=NovaInstanceMeta(name='tempest-TestMinimumBasicScenario-server-1429894149', uuid='92063d97-0979-4e77-bba2-fbdd8a98d30d'), owner=OwnerMeta(userid='b515a0ad4e5e46bdb9b8ef1590088c49', username='tempest-TestMinimumBasicScenario-2112472404-project-member', projectid='a2daf4310913422fa7ec23fe1a468a39', projectname='tempest-TestMinimumBasicScenario-2112472404'), image=ImageMeta(id='252cbd3e-9981-49e2-9887-d01f71609b05', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772599.9837782) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:16:39.985050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:16:39.985412 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:16:39.986317 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:16:39.986496 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:16:39.987459 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:16:39.987770 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T05:16:30Z,direct_url=<?>,disk_format='qcow2',id=252cbd3e-9981-49e2-9887-d01f71609b05,min_disk=0,min_ram=0,name='tempest-scenario-img--54115541',owner='a2daf4310913422fa7ec23fe1a468a39',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T05:16:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:16:39.987921 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:16:39.988015 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:16:39.988132 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:16:39.988268 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:16:39.988366 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:16:39.988515 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:16:39.988611 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:16:39.988720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:16:39.988818 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:16:39.988929 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:16:39.999047 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1429894149',display_name='tempest-TestMinimumBasicScenario-server-1429894149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-1429894149',id=68,image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUYNhYpIfhqYJOn7TxkVObeLSKPBK9S6k8IWORqqcvi9tXvSV6OXywzOD+IY79M3iD37oeRA7wxstb1Q+W2s1AhCz3POmX+MXM0qqtEiX3Ys8hyiO1VXuotk4R0ZnID9w==',key_name='tempest-TestMinimumBasicScenario-463261503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-lmnges2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:37Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=92063d97-0979-4e77-bba2-fbdd8a98d30d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:16:39.999247 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:39.999810 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:40.000374 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'pci_devices' on Instance uuid 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:40.256791 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 35df698f-2a48-4603-b3a8-9e71b2a47b46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:16:40.256908 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:16:40.257002 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 92063d97-0979-4e77-bba2-fbdd8a98d30d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:16:40.257166 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:16:40.257296 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1088MB phys_disk=95GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:16:39 up 48 min,  2 users,  load average: 4.47, 5.01, 4.62\n', 'num_instances': '3', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '3', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1', 'io_workload': '1', 'num_proj_f0f3c957b6c74be39b5af571c5d499a9': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_a2daf4310913422fa7ec23fe1a468a39': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:16:40.428012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:40.428268 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:40.502908 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] End _get_guest_xml xml=<domain type="qemu">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <uuid>92063d97-0979-4e77-bba2-fbdd8a98d30d</uuid>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <name>instance-00000044</name>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestMinimumBasicScenario-server-1429894149</nova:name>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:16:39</nova:creationTime>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:image uuid="252cbd3e-9981-49e2-9887-d01f71609b05">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:properties/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:user uuid="b515a0ad4e5e46bdb9b8ef1590088c49">tempest-TestMinimumBasicScenario-2112472404-project-member</nova:user>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:project uuid="a2daf4310913422fa7ec23fe1a468a39">tempest-TestMinimumBasicScenario-2112472404</nova:project>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="252cbd3e-9981-49e2-9887-d01f71609b05"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         <nova:port uuid="978a5c1d-6fa7-47e6-b35c-4c049234df7a">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.6" ipVersion="4"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <system>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="serial">92063d97-0979-4e77-bba2-fbdd8a98d30d</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="uuid">92063d97-0979-4e77-bba2-fbdd8a98d30d</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </system>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <os>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </os>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <features>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </features>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   <devices>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.config"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </disk>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:fe:28:93"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <target dev="tap978a5c1d-6f"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </interface>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/console.log" append="off"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </serial>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <video>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </video>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </rng>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:   </devices>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]: </domain>
May 26 05:16:40.502908 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Preparing to wait for external event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1429894149',display_name='tempest-TestMinimumBasicScenario-server-1429894149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-1429894149',id=68,image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUYNhYpIfhqYJOn7TxkVObeLSKPBK9S6k8IWORqqcvi9tXvSV6OXywzOD+IY79M3iD37oeRA7wxstb1Q+W2s1AhCz3POmX+MXM0qqtEiX3Ys8hyiO1VXuotk4R0ZnID9w==',key_name='tempest-TestMinimumBasicScenario-463261503',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-lmnges2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:16:37Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=92063d97-0979-4e77-bba2-fbdd8a98d30d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:16:40.505156 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:16:40.505597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.505597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:40.505927 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:16:40.506531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.506692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '873d4621-46b1-569a-be66-f81576780981', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:40.524501 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.525790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:40.527543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.527740 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap978a5c1d-6f, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:40.528142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap978a5c1d-6f, col_values=(('qos', UUID('12aad209-bf16-41ba-845d-16fb1d0da752')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:40.528348 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap978a5c1d-6f, col_values=(('external_ids', {'iface-id': '978a5c1d-6fa7-47e6-b35c-4c049234df7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:28:93', 'vm-uuid': '92063d97-0979-4e77-bba2-fbdd8a98d30d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:16:40.529117 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.530491 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:16:40.535055 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:40.536109 np0000001388 nova-compute[98319]: INFO os_vif [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f')
May 26 05:16:40.930928 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:41.439535 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:16:41.439837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.243s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:41.439973 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:42.052455 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:42.052555 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:42.052681 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No VIF found with MAC fa:16:3e:fe:28:93, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:16:42.053105 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Using config drive
May 26 05:16:42.558367 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:42.661533 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Creating config drive at /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.config
May 26 05:16:42.664730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqgxm_suu {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:42.691581 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:42.717995 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqgxm_suu" returned: 0 in 0.053s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:16:43.096801 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.098088 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.114913 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.192294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.249457 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f6fb49c2-b0f4-46db-a434-586e89015fc2 req-7f5bc6d6-2d3c-4a07-b481-45e02df7c062 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:43.249689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6fb49c2-b0f4-46db-a434-586e89015fc2 req-7f5bc6d6-2d3c-4a07-b481-45e02df7c062 service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:43.249896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6fb49c2-b0f4-46db-a434-586e89015fc2 req-7f5bc6d6-2d3c-4a07-b481-45e02df7c062 service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:43.250562 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6fb49c2-b0f4-46db-a434-586e89015fc2 req-7f5bc6d6-2d3c-4a07-b481-45e02df7c062 service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:43.250562 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f6fb49c2-b0f4-46db-a434-586e89015fc2 req-7f5bc6d6-2d3c-4a07-b481-45e02df7c062 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Processing event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:16:43.414258 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.415493 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.435424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:43.767421 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772603.767031, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:43.767844 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Started (Lifecycle Event)
May 26 05:16:43.769179 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:16:43.771353 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:16:43.773658 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance spawned successfully.
May 26 05:16:43.773995 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:16:44.270162 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:44.272353 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:44.279976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.280105 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.280393 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.280601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.280861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.281086 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:16:44.774544 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:16:44.774981 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772604.774639, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:44.774981 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Paused (Lifecycle Event)
May 26 05:16:44.785065 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Took 6.38 seconds to spawn the instance on the hypervisor.
May 26 05:16:44.785367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:45.276930 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:45.278774 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772605.278544, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:16:45.278897 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Resumed (Lifecycle Event)
May 26 05:16:45.292695 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Took 11.82 seconds to build instance.
May 26 05:16:45.339321 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:45.339620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:45.339844 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:45.340011 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:45.340955 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] No waiting events found dispatching network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:16:45.341177 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-975ce2fa-c099-4f39-a9d6-dd71644108a1 req-cedbc390-e15e-4e1b-94dd-e01e5636e7cd service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received unexpected event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a for instance with vm_state active and task_state None.
May 26 05:16:45.439638 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:16:45.439941 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.18 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:16:45.529697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:45.782102 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:16:45.787690 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:16:45.793952 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-310e91fd-8753-44c6-ba0e-72d330517769 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.332s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:47.694353 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:47.808715 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:47.810296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:48.302608 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:48.312479 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:49.317307 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:49.903524 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:50.530553 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:50.550298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:50.550544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:50.552464 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Attaching volume b868d915-864c-4f95-901c-d632a5fd07d6 to /dev/vdb
May 26 05:16:50.593886 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:50.606952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:16:50.627318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:16:50.682860 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:16:50.683150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:16:50.692671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:16:50.693805 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe62:de92', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fe2c:7d6e', 'fe80::9098:e9ff:fee9:97c9', 'fe80::fc16:3eff:fefe:2893', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:16:50.693955 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:16:50.694085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:16:50.694340 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== get_connector_properties: return (100ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:50.694572 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating existing volume attachment record: dd0fc32d-060d-44c7-8fc1-63e66eacaab8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:16:51.248581 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:16:51.248687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:16:51.248889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:51.249357 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:51.249594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:16:51.263442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:51.264868 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:51.265108 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:51.265816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:16:51.266539 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:16:51.266684 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:51.280946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:51.280946 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:51.285753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:16:51.285753 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:51.296920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6] added
May 26 05:16:51.296920 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:51.296920 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:51.296920 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:51.296920 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:51.296920 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:51.296920 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:51.297364 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:51.298154 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:51.298427 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:51.302454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6] added
May 26 05:16:51.302454 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:16:51.302454 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:51.302454 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:51.302454 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:16:51.302454 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:16:51.302454 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:51.302693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:16:51.302781 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.036(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:16:51.302944 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:16:52.299113 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:16:52.303386 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:52.317995 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:52.317995 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.329899 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:16:52.332612 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:16:52.332612 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.342802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.343759 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.358516 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.358516 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.358516 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.358516 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.358516 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:52.358745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.358745 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.358745 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.358745 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.358745 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:52.359440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.359440 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.359440 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.359440 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.359440 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:52.359620 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.359620 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.359620 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.359620 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.359620 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:52.385932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.40.100,3260]
May 26 05:16:52.385932 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.40.100,3260] successful.
May 26 05:16:52.385932 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.395754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.402012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.50.100,3260]
May 26 05:16:52.402012 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.50.100,3260] successful.
May 26 05:16:52.402012 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.410036 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.410292 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:52.410401 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.147s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:52.410531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:52.411451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('7', '-', '-', 0) found on session 187 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:52.411580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:52.417993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:16:52.429993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 187 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:52.429993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:16:52.433794 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:16:52.434080 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:52.434190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:16:52.435066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] HCTL ('8', '-', '-', 0) found on session 188 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:16:52.435210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:16:52.457460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Searching for a device in session 188 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:16:52.457460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:16:52.694692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:53.266954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:16:53.872666 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:54.281734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found WWN 330000000bbb57175 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:16:54.281967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:16:54.282107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000bbb57175', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb57175'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:16:54.283639 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000bbb57175', 'path': '/dev/dm-1', 'multipath_id': '330000000bbb57175'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:16:54.284645 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:16:54.787981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Attempting to attach volume b868d915-864c-4f95-901c-d632a5fd07d6 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:16:54.789279 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:   <alias name="ua-b868d915-864c-4f95-901c-d632a5fd07d6"/>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:   <serial>b868d915-864c-4f95-901c-d632a5fd07d6</serial>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]: </disk>
May 26 05:16:54.789279 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:16:55.534715 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:56.436520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:56.436722 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:56.436834 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:16:56.436982 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] No VIF found with MAC fa:16:3e:fe:28:93, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:16:57.108163 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:57.108571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:57.609912 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:16:57.697424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:57.990185 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-21e8201b-0193-452e-be24-27d62e1b4f5b tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.440s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:16:58.168969 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:58.169480 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:58.172192 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:16:58.172343 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Claim successful on node np0000001388
May 26 05:16:59.069671 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:16:59.070066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing instance network info cache due to event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:16:59.070348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:16:59.070735 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:16:59.070817 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:16:59.153636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:16:59.382022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:16:59.382512 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:16:59.498078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:16:59.498667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:16:59.573349 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:16:59.885711 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:16:59.898081 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:00.004226 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:00.068039 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updated VIF entry in instance network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:00.068340 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:00.396511 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.227s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:00.396956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:17:00.535973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:00.570164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-93bf8782-a2e1-4f21-8083-2c99cb2d21d1 req-cc383e84-0568-47f3-aa4b-9aaad7d6cc07 service nova] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:00.902074 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:17:00.903053 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:17:00.903053 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:00.903053 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:00.916446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:00.916671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:00.916856 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:00.918748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=98319) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3590}}
May 26 05:17:00.919304 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'flavor' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:00.980602 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3ee150517d34539b56afa2c9433e087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56542810ab5d4dd9b443231e8931b871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:17:01.014471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.515s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:01.125285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:01.125648 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing instance network info cache due to event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:01.125822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:01.125946 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:01.126077 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:01.404875 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:17:01.438871 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Successfully created port: 896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:17:01.628472 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:01.874885 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Successfully updated port: 896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:17:01.906592 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:01.908120 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:17:01.914883 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:01.915260 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing instance network info cache due to event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:01.915461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] Acquiring lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:01.915600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] Acquired lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:01.915745 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing network info cache for port 896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:01.940286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:01.942116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:01.957750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:01.960320 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:01.976895 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:01.981832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:02.073321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:02.073533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:02.073784 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attaching volume 0c778dd6-5d13-438a-85d2-05e1375c8694 to /dev/vdb
May 26 05:17:02.078877 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updated VIF entry in instance network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:02.079315 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:02.088565 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:02.088754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:02.088923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:02.089355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:02.089808 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:02.089931 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6dae5192-1584-434e-806b-fe6bad6e22e6 req-bf6a945c-cf27-4429-9f58-31dd3cdcccc6 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received unexpected event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with vm_state active and task_state powering-off.
May 26 05:17:02.124821 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:02.137552 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:17:02.161524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:02.204355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:17:02.204643 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:17:02.213828 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:17:02.214856 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe2c:7d6e', 'fe80::9098:e9ff:fee9:97c9', 'fe80::fc16:3eff:fefe:2893', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:17:02.215014 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:17:02.215784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:17:02.215784 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:02.215784 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating existing volume attachment record: 35c65e0e-a000-400c-b9fe-9aa1adc81b8b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:17:02.222406 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:02.245716 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999676263999845 future=<Future at 0x7d7ac43a08c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:02.246187 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99929208399999 future=<Future at 0x7d7ac43a08c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:02.246187 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999185564000072 future=<Future at 0x7d7ac43a08c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:02.247267 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance destroyed successfully.
May 26 05:17:02.247814 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'numa_topology' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:02.376989 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:02.417986 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:02.472050 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:17:02.583614 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:02.584664 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e7df9a2-66ba-46a9-bf3c-65f663d1f40e req-f4272b0a-df91-4e48-a603-85c07528b44f service nova] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:02.713884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:02.750266 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:02.750436 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:02.767265 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:17:02.767600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:02.767772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:02.768225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:02.768498 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:17:02.780592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:02.781499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:02.782164 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:02.782403 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:02.782765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:02.782995 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:02.795023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:02.795023 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:02.800439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:02.800439 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:02.807651 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694] added
May 26 05:17:02.807651 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:02.807651 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:02.807651 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:02.807651 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:02.807651 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:02.807651 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:02.807909 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:02.808213 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0257(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:02.808455 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:02.811251 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694] added
May 26 05:17:02.811251 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:02.811251 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:02.811251 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:02.811251 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:02.811251 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:02.811251 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:02.811540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:02.811649 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:02.811821 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:02.916776 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:17:02.918229 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:17:02.918472 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Creating image(s)
May 26 05:17:02.918986 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:02.919151 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:02.919739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:02.920351 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:17:02.923774 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:17:02.924885 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:03.019505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:03.019987 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:03.020485 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:03.020920 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:17:03.023515 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:17:03.023814 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:03.086477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c9fc5a42-a694-4dcf-a28e-fd53f706dbfd req-46f8ac35-62b3-4d60-8781-1b8fc3408027 service nova] Releasing lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:03.087056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquired lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:03.087291 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:17:03.121852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.098s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:03.122542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:03.176810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:03.177248 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:03.177687 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:03.259020 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-82e74ae3-5847-4149-8266-6c615dc6bf00 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 2.342s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:03.260401 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:03.260694 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:17:03.261039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:03.353557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:03.353866 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Cannot resize image /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:17:03.354223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:17:03.354388 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Ensure instance console log exists: /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:17:03.354672 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:03.354878 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:03.355009 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:03.645217 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:17:03.790303 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:03.808985 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:03.812378 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:03.821803 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:03.821803 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:03.828278 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:03.828278 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.834315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.840605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.855021 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.855310 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.859934 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.860098 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:03.894494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.40.100,3260]
May 26 05:17:03.894494 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.40.100,3260] successful.
May 26 05:17:03.894494 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.899252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.50.100,3260]
May 26 05:17:03.899252 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.50.100,3260] successful.
May 26 05:17:03.899252 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.906522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.913250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:03.917181 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating instance_info_cache with network_info: [{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.924325 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.924620 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:03.925028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.143s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:03.925224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:03.926205 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('13', '-', '-', 0) found on session 189 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:03.926384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.932132 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:03.932478 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:03.932700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.150s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:03.932700 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:03.933707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('14', '-', '-', 0) found on session 190 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:03.933799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:03.940023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 189 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:03.940180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:03.949881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 190 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:03.949881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:04.137823 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:04.138345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:04.138498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:04.138847 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:04.138847 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:04.138847 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3a65ccb5-9d10-47ea-9c09-ca49d28ead12 req-4934f4e8-458c-47ed-ad21-f68ba140c936 service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received unexpected event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with vm_state stopped and task_state None.
May 26 05:17:04.419700 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Releasing lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:04.420000 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance network_info: |[{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:17:04.421540 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Start _get_guest_xml network_info=[{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:17:04.425332 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:17:04.426492 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-355136792', uuid='25b52548-45d5-4109-bd5b-d7851c560095'), owner=OwnerMeta(userid='a3ee150517d34539b56afa2c9433e087', username='tempest-VolumeMultiattachTests-2100574999-project-member', projectid='56542810ab5d4dd9b443231e8931b871', projectname='tempest-VolumeMultiattachTests-2100574999'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772624.4261458) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:17:04.427594 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:17:04.427928 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:17:04.428863 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:17:04.429057 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:17:04.429879 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:17:04.430170 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:17:04.430309 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:17:04.430406 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:17:04.430547 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:17:04.430626 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:17:04.430710 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:17:04.430886 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:17:04.430994 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:17:04.431087 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:17:04.431180 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:17:04.431310 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:17:04.441617 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-355136792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-355136792',id=69,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-0z2hi7kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=25b52548-45d5-4109-bd5b-d7851c560095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:17:04.441821 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:04.442351 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:04.442928 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'pci_devices' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:04.715845 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'flavor' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:04.782254 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:17:04.945494 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] End _get_guest_xml xml=<domain type="qemu">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <uuid>25b52548-45d5-4109-bd5b-d7851c560095</uuid>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <name>instance-00000045</name>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-355136792</nova:name>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:17:04</nova:creationTime>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:user uuid="a3ee150517d34539b56afa2c9433e087">tempest-VolumeMultiattachTests-2100574999-project-member</nova:user>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:project uuid="56542810ab5d4dd9b443231e8931b871">tempest-VolumeMultiattachTests-2100574999</nova:project>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         <nova:port uuid="896b9d6e-f7a4-431c-8618-e3d6812c77a0">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <system>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="serial">25b52548-45d5-4109-bd5b-d7851c560095</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="uuid">25b52548-45d5-4109-bd5b-d7851c560095</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </system>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <os>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </os>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <features>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </features>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   <devices>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.config"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:22:82:4b"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <target dev="tap896b9d6e-f7"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </interface>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/console.log" append="off"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </serial>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <video>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </video>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </rng>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:   </devices>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]: </domain>
May 26 05:17:04.945494 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Preparing to wait for external event network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-355136792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-355136792',id=69,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-0z2hi7kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=25b52548-45d5-4109-bd5b-d7851c560095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:04.947513 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:17:04.947836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.948126 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:04.948450 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:17:04.951019 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.951205 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '56b5869f-7ce3-5ad6-bd7d-c57f35ff3731', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:04.965595 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.966386 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:04.971029 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.973013 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.973190 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap896b9d6e-f7, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:04.973627 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap896b9d6e-f7, col_values=(('qos', UUID('36043c70-2c7a-4f0f-a5b3-9bd52eb4bf68')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:04.973819 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap896b9d6e-f7, col_values=(('external_ids', {'iface-id': '896b9d6e-f7a4-431c-8618-e3d6812c77a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:82:4b', 'vm-uuid': '25b52548-45d5-4109-bd5b-d7851c560095'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:04.974537 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.975939 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:04.983865 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:04.984785 np0000001388 nova-compute[98319]: INFO os_vif [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7')
May 26 05:17:05.219773 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:05.219920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:05.220007 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:17:05.220123 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'info_cache' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:05.722327 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,info_cache {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:05.797468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found WWN 33000000004b7ff7c for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:17:05.797819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:05.798012 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '33000000004b7ff7c', 'path': '/dev/dm-7', 'multipath_id': '33000000004b7ff7c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:05.798132 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000004b7ff7c', 'path': '/dev/dm-7', 'multipath_id': '33000000004b7ff7c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:17:05.800471 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:06.224502 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:06.302903 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attempting to attach volume 0c778dd6-5d13-438a-85d2-05e1375c8694 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:17:06.303812 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:   <alias name="ua-0c778dd6-5d13-438a-85d2-05e1375c8694"/>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:   <serial>0c778dd6-5d13-438a-85d2-05e1375c8694</serial>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:06.303812 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:17:06.494614 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:06.499967 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:06.500177 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:06.500308 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:22:82:4b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:17:06.500767 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Using config drive
May 26 05:17:06.606715 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:07.005829 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:07.108803 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-35df698f-2a48-4603-b3a8-9e71b2a47b46" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:07.118643 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Creating config drive at /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.config
May 26 05:17:07.123264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp46qeyze2 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:07.186083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp46qeyze2" returned: 0 in 0.062s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:07.580131 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.604170 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.688384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.715810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.744232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fb04a67-0b30-4dfa-b754-6d0eb55f2929 req-14c20f4d-7972-4b3a-af11-964868c979e9 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:07.745269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb04a67-0b30-4dfa-b754-6d0eb55f2929 req-14c20f4d-7972-4b3a-af11-964868c979e9 service nova] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:07.745269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb04a67-0b30-4dfa-b754-6d0eb55f2929 req-14c20f4d-7972-4b3a-af11-964868c979e9 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:07.745269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8fb04a67-0b30-4dfa-b754-6d0eb55f2929 req-14c20f4d-7972-4b3a-af11-964868c979e9 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:07.745269 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8fb04a67-0b30-4dfa-b754-6d0eb55f2929 req-14c20f4d-7972-4b3a-af11-964868c979e9 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Processing event network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:17:07.912178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.918683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.920284 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:07.938397 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:07.938598 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:07.938742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:07.938877 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No VIF found with MAC fa:16:3e:2c:7d:6e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:17:07.945079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:08.121268 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance destroyed successfully.
May 26 05:17:08.121662 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'numa_topology' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:08.280427 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772628.28006, 25b52548-45d5-4109-bd5b-d7851c560095 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:08.281075 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:17:08.281490 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] VM Started (Lifecycle Event)
May 26 05:17:08.283586 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:17:08.287187 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance spawned successfully.
May 26 05:17:08.287508 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:17:08.623385 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,info_cache,numa_topology {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:08.623790 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:08.784672 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:08.786557 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:08.796513 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:08.797214 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:08.797829 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:08.799965 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:08.800369 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:08.800694 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:09.125620 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,info_cache,numa_topology,resources {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:09.126413 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:17:09.126648 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:09.127307 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:09.127543 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:17:09.128853 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.129074 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5a6678a-e9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:09.130647 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.131682 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:09.131997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.132785 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.132934 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=590053d3-9f83-4f75-b63b-f5f9da998ff7) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:09.133492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.134075 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:09.134407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:09.136365 np0000001388 nova-compute[98319]: INFO os_vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9')
May 26 05:17:09.138053 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:09.138546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:09.138749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:09.139250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:09.139676 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:09.139939 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:09.167628 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [183] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [184] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:09.167865 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:09.168085 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '183'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '184'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '190')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:09.168218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '183')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:09.169424 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '184')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:09.170490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46c8fe0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:09.170712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:09.170962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 330000000447904b7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:09.235987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:09.272669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:09.290216 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:17:09.290216 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772629.2891784, 25b52548-45d5-4109-bd5b-d7851c560095 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:09.290216 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] VM Paused (Lifecycle Event)
May 26 05:17:09.308306 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Took 6.39 seconds to spawn the instance on the hypervisor.
May 26 05:17:09.308417 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:09.320924 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:09.321358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:09.325219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:09.337283 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:09.337526 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:09.348699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.386730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 183, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260]
May 26 05:17:09.386730 np0000001388 nova-compute[98319]: Logout of [sid: 183, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260] successful.
May 26 05:17:09.386730 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.403538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.414106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.445385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 184, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260]
May 26 05:17:09.445385 np0000001388 nova-compute[98319]: Logout of [sid: 184, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260] successful.
May 26 05:17:09.445385 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.461010 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:09.461256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:09.461371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (322ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:09.461474 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:09.464211 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start _get_guest_xml network_info=[{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '70ffb422-ded5-4a20-a10e-18470c0c4831', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, 'status': 'reserved', 'instance': '35df698f-2a48-4603-b3a8-9e71b2a47b46', 'attached_at': '', 'detached_at': '', 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'serial': 'eabc6170-6aa4-4fad-87c3-962e34a207e6'}, 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:17:09.465862 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:17:09.466771 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-337625935', uuid='35df698f-2a48-4603-b3a8-9e71b2a47b46'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772629.4664948) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:17:09.467628 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:17:09.467977 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:17:09.468806 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:17:09.469050 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:17:09.469974 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:17:09.470362 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:17:09.470567 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:17:09.470722 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:17:09.470925 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:17:09.471096 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:17:09.471274 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:17:09.471543 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:17:09.471729 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:17:09.471893 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:17:09.472085 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:17:09.472286 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:17:09.472458 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'vcpu_model' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:09.494518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-215f4ffb-b8e0-445b-ac73-fc2af2cef913 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.421s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:09.793215 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:09.795731 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772629.7945726, 25b52548-45d5-4109-bd5b-d7851c560095 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:09.795731 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] VM Resumed (Lifecycle Event)
May 26 05:17:09.800067 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:09.800459 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:09.800641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:09.800759 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:09.800897 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] No waiting events found dispatching network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:09.801021 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3fa439e7-7a46-4260-a4b2-79fdbe9b0fe3 req-fe3bf03a-6d53-488d-9297-1fa2611ffbb6 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received unexpected event network-vif-plugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 for instance with vm_state active and task_state None.
May 26 05:17:09.815672 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Took 11.70 seconds to build instance.
May 26 05:17:09.974314 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:09.983560 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:10.069222 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:10.069769 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:10.070083 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:10.070763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:10.071333 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:17:10.071747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:10.071963 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:10.072342 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:10.072618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:17:10.083984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:10.084569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:10.085445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:10.085658 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:10.089054 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:10.089054 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:10.101366 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:10.101366 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:10.106756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:10.106756 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6] added
May 26 05:17:10.113954 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:10.113954 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:10.113954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:10.114257 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:10.114363 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:10.118319 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:10.118510 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6] added
May 26 05:17:10.121719 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:10.121719 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0357(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:10.121719 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:10.303830 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:10.306806 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:10.317010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bca7a59f-3546-446f-b2ff-9dc28b5de3c3 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.208s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:10.624125 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:11.114827 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:11.121925 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:11.129720 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:11.129720 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:11.137174 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:11.137174 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.144449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.150077 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.164712 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.164954 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.169057 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.169340 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:11.209812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260]
May 26 05:17:11.209812 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260] successful.
May 26 05:17:11.209812 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.210542 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260]
May 26 05:17:11.210542 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260] successful.
May 26 05:17:11.210542 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.221975 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.223743 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:11.224345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing instance network info cache due to event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:11.224549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] Acquiring lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:11.224699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] Acquired lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:11.224814 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing network info cache for port 896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:11.228644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.241716 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.242020 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:11.242263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:11.242360 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:11.243491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 191 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:11.243640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.248529 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:11.248911 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:11.249215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.164s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:11.249369 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:11.250161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 192 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:11.250278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:11.256138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 191 and hctl ['9', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:11.266988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 192 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:11.629500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.511s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:11.727082 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:12.015570 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:12.140800 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updated VIF entry in instance network info cache for port 896b9d6e-f7a4-431c-8618-e3d6812c77a0. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:12.141059 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating instance_info_cache with network_info: [{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:12.256716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 191 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:12.256837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:12.267151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 192 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:12.267151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:12.643523 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0cc7a79b-eb15-4063-a100-e6a274d7b2d6 req-ab52b1db-0418-4081-833a-2dcd7c6042bc service nova] Releasing lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:12.706810 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:12.706972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:12.707160 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attaching volume 967856b9-1bcb-482a-814a-d92f239d900f to /dev/vdc
May 26 05:17:12.716970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:12.735030 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:12.735212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:12.735415 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Rebooting instance
May 26 05:17:12.747364 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:12.759436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:17:12.782856 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:12.826883 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:17:12.827140 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:17:12.836790 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:17:12.837810 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe2c:7d6e', 'fe80::9098:e9ff:fee9:97c9', 'fe80::fc16:3eff:fefe:2893', 'fe80::cfa:15ff:febe:944a', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca'] 
May 26 05:17:12.837914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:17:12.838031 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:17:12.838289 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== get_connector_properties: return (90ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:12.838532 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating existing volume attachment record: c505d19b-0d33-4c6c-aec9-617d18e949fe {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:17:13.090362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:17:13.286310 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:13.286446 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:13.286626 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:17:13.389223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:17:13.389627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:13.389797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:13.789316 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:14.082954 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:14.106766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 330000000447904b7 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:17:14.107286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:14.107500 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (4035ms) {'type': 'block', 'scsi_wwn': '330000000447904b7', 'path': '/dev/dm-0', 'multipath_id': '330000000447904b7'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:14.107666 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000447904b7', 'path': '/dev/dm-0', 'multipath_id': '330000000447904b7'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:17:14.108116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.718s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:14.108396 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:17:14.121222 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:14.122047 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:14.122730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:14.123192 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:14.123549 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:14.123777 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:14.134703 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:14.136739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:14.136739 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:14.144984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:14.144984 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:14.154551 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f] added
May 26 05:17:14.154551 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:14.154551 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:14.154551 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:14.154551 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:14.154551 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:14.154551 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:14.154907 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:14.154998 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0318(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:14.155216 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:14.159805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f] added
May 26 05:17:14.159805 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:14.159805 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:14.159805 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:14.159805 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:14.159805 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:14.159805 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:14.160043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:14.160100 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0367(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:14.160685 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:14.202390 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:14.613159 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:17:14.613424 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:14.613982 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:14.614652 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:14.704714 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:15.116573 np0000001388 nova-compute[98319]: DEBUG nova.objects.base [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Object Instance<35df698f-2a48-4603-b3a8-9e71b2a47b46> lazy-loaded attributes: flavor,info_cache,numa_topology,resources,vcpu_model,pci_devices {{(pid=98319) wrapper /opt/stack/nova/nova/objects/base.py:136}}
May 26 05:17:15.117724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] End _get_guest_xml xml=<domain type="qemu">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <uuid>35df698f-2a48-4603-b3a8-9e71b2a47b46</uuid>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <name>instance-00000042</name>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-337625935</nova:name>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:17:09</nova:creationTime>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         <nova:port uuid="e5a6678a-e931-4cf3-be83-e619f96d9f43">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.12" ipVersion="4"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <system>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="serial">35df698f-2a48-4603-b3a8-9e71b2a47b46</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="uuid">35df698f-2a48-4603-b3a8-9e71b2a47b46</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </system>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <os>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </os>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <features>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </features>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   <devices>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/disk.config"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <alias name="ua-eabc6170-6aa4-4fad-87c3-962e34a207e6"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <serial>eabc6170-6aa4-4fad-87c3-962e34a207e6</serial>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:62:de:92"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <target dev="tape5a6678a-e9"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </interface>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46/console.log" append="off"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </serial>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <video>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </video>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </rng>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:   </devices>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]: </domain>
May 26 05:17:15.117724 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:17:15.119759 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:17:15.119759 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:17:15.119759 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:15.119759 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:15.119759 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:17:15.120183 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.120488 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:15.120770 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:17:15.121453 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.121627 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dd6edb0e-cc59-5d97-a874-8e6da9aa632a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:15.122473 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.123259 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:15.123945 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.126637 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.126781 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5a6678a-e9, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:15.127063 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5a6678a-e9, col_values=(('qos', UUID('60c661e5-4c9c-440e-8f5c-113d8d9867ef')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:15.127253 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5a6678a-e9, col_values=(('external_ids', {'iface-id': 'e5a6678a-e931-4cf3-be83-e619f96d9f43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:de:92', 'vm-uuid': '35df698f-2a48-4603-b3a8-9e71b2a47b46'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:15.128004 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.129177 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:15.134805 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.135859 np0000001388 nova-compute[98319]: INFO os_vif [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9')
May 26 05:17:15.155657 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:15.161063 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:15.169445 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:15.169445 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:15.177563 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:15.177563 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.184415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.190397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.202220 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:15.209678 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.211000 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.211312 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:15.251583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.40.100,3260]
May 26 05:17:15.251583 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.40.100,3260] successful.
May 26 05:17:15.251583 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.256971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.50.100,3260]
May 26 05:17:15.256971 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.50.100,3260] successful.
May 26 05:17:15.256971 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.263634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.271164 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.283142 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.283451 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:15.283623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:15.283623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:15.284713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('15', '-', '-', 0) found on session 193 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:15.284814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.290033 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:15.290515 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:15.290814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.168s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:15.290814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:15.291769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] HCTL ('16', '-', '-', 0) found on session 194 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:15.291911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:15.300684 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 193 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:15.300876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:15.307509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Searching for a device in session 194 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:15.307509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:15.558902 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.587832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.589340 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.654235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.751602 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:15.751779 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:15.751929 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:15.752395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:15.752559 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:15.752714 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e0b68ed0-e34f-4ede-9551-f29ecff305b6 req-a452ac25-124b-40de-9d7f-28356d02957e service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received unexpected event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with vm_state stopped and task_state powering-on.
May 26 05:17:15.905885 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.907360 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.909112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:15.930596 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:16.123042 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:17:16.250716 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 35df698f-2a48-4603-b3a8-9e71b2a47b46 due to new event <LifecycleEvent: 1779772636.2499754, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:17:16.251452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance event wait completed in 0 seconds for  {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:17:16.251677 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772636.2499754, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:16.251877 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Resumed (Lifecycle Event)
May 26 05:17:16.256991 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance rebooted successfully.
May 26 05:17:16.754976 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:16.756823 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:17.143253 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found WWN 33000000082f3585a for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:17:17.143809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:17.143809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== connect_volume: return (3754ms) {'type': 'block', 'scsi_wwn': '33000000082f3585a', 'path': '/dev/dm-8', 'multipath_id': '33000000082f3585a'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:17.144151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000082f3585a', 'path': '/dev/dm-8', 'multipath_id': '33000000082f3585a'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:17:17.146770 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:17.245792 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00037725800029875245 future=<Future at 0x7d7ac43a08c0 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:17.245960 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:17.262223 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:17:17.262223 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772637.2598548, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:17.262223 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Started (Lifecycle Event)
May 26 05:17:17.650022 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attempting to attach volume 967856b9-1bcb-482a-814a-d92f239d900f with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:17:17.651075 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:   <alias name="ua-967856b9-1bcb-482a-814a-d92f239d900f"/>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:   <serial>967856b9-1bcb-482a-814a-d92f239d900f</serial>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:17.651075 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:17:17.721037 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:17.766345 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:17.769284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:17.769450 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:17.769624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:62:de:92, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:17:17.769913 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8dc925c1-420f-47b2-a836-60f524bbab55 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:17.771854 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:17.835748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:17.835935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:17.836063 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:17.836208 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:17.836379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:17.836437 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-fb893a5b-af1d-48f7-add4-d3a4da9cac6a req-953f732d-58e5-4c0a-935c-877dbde5c2cc service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received unexpected event network-vif-plugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with vm_state active and task_state None.
May 26 05:17:18.273849 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] During sync_power_state the instance has a pending task (powering-on). Skip.
May 26 05:17:18.640638 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:18.658743 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:18.662916 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:18.679735 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:18.801369 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ab88d4c9-9221-43b7-8dfb-52a62f2ca0f4 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Get console output
May 26 05:17:18.809956 np0000001388 nova-compute[98319]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
May 26 05:17:18.822111 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:18.822348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:18.822535 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:18.822690 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:18.823003 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] No waiting events found dispatching network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:18.823003 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-933bcff3-2947-430c-ab21-56b55ce6f2f6 req-a4b6a995-3bf5-4663-b5bb-1e202185221f service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received unexpected event network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a for instance with vm_state active and task_state reboot_started.
May 26 05:17:18.980700 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999498399999993 future=<Future at 0x7d7ac4664530 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:18.981541 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99833317699995 future=<Future at 0x7d7ac4664530 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:18.981541 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998144474000128 future=<Future at 0x7d7ac4664530 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:19.237676 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance shutdown successfully.
May 26 05:17:19.295920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:19.296495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:19.296495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:19.296495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:19.296495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] No VIF found with MAC fa:16:3e:2c:7d:6e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:17:19.703485 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:19.730273 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:19.733645 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:19.831079 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.080852 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.082881 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.084486 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.085813 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.103837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.128421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:20.514410 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Removed pending STOPPED event for 92063d97-0979-4e77-bba2-fbdd8a98d30d due to new event <LifecycleEvent: 1779772640.5123124, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Resumed> {{(pid=98319) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:520}}
May 26 05:17:20.516413 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772640.5123124, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:20.516413 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Resumed (Lifecycle Event)
May 26 05:17:20.521632 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance running successfully.
May 26 05:17:20.522455 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance soft rebooted successfully.
May 26 05:17:20.522455 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:20.844620 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3c4349cd-d1e2-4b24-aba7-afa03f7bca15 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:20.892678 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:20.893908 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:20.895034 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:20.895324 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:20.895515 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] No waiting events found dispatching network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:20.895687 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received unexpected event network-vif-unplugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a for instance with vm_state active and task_state None.
May 26 05:17:20.895846 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:20.896090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:20.896301 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:20.896461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:20.896614 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] No waiting events found dispatching network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:20.896778 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received unexpected event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a for instance with vm_state active and task_state None.
May 26 05:17:20.896937 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:20.897121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:20.898569 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:20.898703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:20.901543 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] No waiting events found dispatching network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:20.901543 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-6f1fe1ae-768b-4a20-b000-a693741f85c9 req-caa87524-9c1d-409a-ba6a-d981f5eb135b service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received unexpected event network-vif-plugged-978a5c1d-6fa7-47e6-b35c-4c049234df7a for instance with vm_state active and task_state None.
May 26 05:17:20.961101 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:20.961413 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:20.961647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:20.961833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:20.961983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:20.964355 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Terminating instance
May 26 05:17:21.020399 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:21.022692 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:21.030562 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d183b5f7-c330-474d-9475-88fb974bce73 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:21.468969 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:17:21.485993 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:21.487565 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:21.507021 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:21.507483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:21.526454 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772641.5255437, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:21.526839 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Started (Lifecycle Event)
May 26 05:17:21.528836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:21.637117 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:21.637117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:21.637117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:21.637335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:21.637465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:21.637615 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-64feb42c-189a-4e57-86b2-564b7be337fe req-23f8dedf-1534-46aa-a0aa-6271369f013d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:17:21.795119 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Instance destroyed successfully.
May 26 05:17:21.795487 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 35df698f-2a48-4603-b3a8-9e71b2a47b46 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:22.029101 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:22.031289 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:22.299309 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-337625935',display_name='tempest-TestVolumeBootPattern-server-337625935',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-337625935',id=66,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAixlaTPsh5yMxv0i9gTUHlnBB08blJTpvVHsVWeIDFNVAV1f8NnKU9wkPuHBn+BkyDovXbYhao4KGP68sxcWKDZ5tfsHNgY4qLqgn4OiWDcj5IyuzQ44VmmicL+BZP+xA==',key_name='tempest-keypair-1761741026',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:22Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-y6yzjnp4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=35df698f-2a48-4603-b3a8-9e71b2a47b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:17:22.299595 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "address": "fa:16:3e:62:de:92", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape5a6678a-e9", "ovs_interfaceid": "e5a6678a-e931-4cf3-be83-e619f96d9f43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:22.300214 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:22.300628 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:17:22.302297 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.302513 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5a6678a-e9, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:22.304667 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.304748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:22.305119 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.305905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.306066 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60c661e5-4c9c-440e-8f5c-113d8d9867ef) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:22.307534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.307534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:22.307534 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:22.309354 np0000001388 nova-compute[98319]: INFO os_vif [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:de:92,bridge_name='br-int',has_traffic_filtering=True,id=e5a6678a-e931-4cf3-be83-e619f96d9f43,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5a6678a-e9')
May 26 05:17:22.310712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:22.310980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:22.311138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:22.311875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:22.312496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eabc6170-6aa4-4fad-87c3-962e34a207e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:22.312496 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:22.342145 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [191] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [192] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6 (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:22.342608 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '190'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '191'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '192'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:22.342608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '192')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:22.343753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6', '191')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:22.344701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4442340>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'): ({'sdd'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:22.344883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:22.345105 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 330000000447904b7 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:22.403622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:22.442933 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:22.490799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:22.491018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:22.492317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:22.503592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:22.503837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:22.519582 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.533565 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999740595000276 future=<Future at 0x7d7aa4257ce0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:22.554235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 192, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260]
May 26 05:17:22.554235 np0000001388 nova-compute[98319]: Logout of [sid: 192, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.40.100,3260] successful.
May 26 05:17:22.554235 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.572567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.584618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.620862 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 191, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260]
May 26 05:17:22.620862 np0000001388 nova-compute[98319]: Logout of [sid: 191, target: iqn.2023-03.storpool.com:os--volume-eabc6170-6aa4-4fad-87c3-962e34a207e6, portal: 192.168.50.100,3260] successful.
May 26 05:17:22.620862 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.638380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:22.638568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:22.638676 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (328ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:22.638778 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:22.639024 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Deleting instance files /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46_del
May 26 05:17:22.639570 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Deletion of /opt/stack/data/nova/instances/35df698f-2a48-4603-b3a8-9e71b2a47b46_del complete
May 26 05:17:22.736069 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:23.145669 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Took 1.68 seconds to destroy the instance on the hypervisor.
May 26 05:17:23.146267 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:17:23.146791 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:17:23.146983 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:17:23.147349 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:23.207859 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:23.633074 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6a19234d-6040-4afe-8031-95f042d7f7b4 req-fe78d50d-f0b4-42f3-b49c-521a3433700b service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-deleted-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:23.635304 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-6a19234d-6040-4afe-8031-95f042d7f7b4 req-fe78d50d-f0b4-42f3-b49c-521a3433700b service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Neutron deleted interface e5a6678a-e931-4cf3-be83-e619f96d9f43; detaching it from the instance and deleting it from the info cache
May 26 05:17:23.635304 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6a19234d-6040-4afe-8031-95f042d7f7b4 req-fe78d50d-f0b4-42f3-b49c-521a3433700b service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:23.693765 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:23.694169 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] Acquiring lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:23.694464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:23.694545 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:23.694724 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] No waiting events found dispatching network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:23.694868 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c59ded1d-74a6-455a-89cf-a3279aa2a1ce req-672c2cc7-6922-492c-8645-430e0fe7bd7d service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Received event network-vif-unplugged-e5a6678a-e931-4cf3-be83-e619f96d9f43 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:17:24.063010 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:24.138760 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6a19234d-6040-4afe-8031-95f042d7f7b4 req-fe78d50d-f0b4-42f3-b49c-521a3433700b service nova] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Detach interface failed, port_id=e5a6678a-e931-4cf3-be83-e619f96d9f43, reason: Instance 35df698f-2a48-4603-b3a8-9e71b2a47b46 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:17:24.564922 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Took 1.42 seconds to deallocate network for instance.
May 26 05:17:25.110981 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:17:25.616348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:25.616632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:25.845726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:17:25.845921 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:17:26.180047 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:26.180612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:26.348961 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:17:26.682495 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Detaching volume 0c778dd6-5d13-438a-85d2-05e1375c8694
May 26 05:17:26.717324 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attempting to driver detach volume 0c778dd6-5d13-438a-85d2-05e1375c8694 from mountpoint /dev/vdb
May 26 05:17:26.720981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found disk vdb by alias ua-0c778dd6-5d13-438a-85d2-05e1375c8694 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:26.721960 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found disk vdb by alias ua-0c778dd6-5d13-438a-85d2-05e1375c8694 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:26.722082 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Attempting to detach device vdb from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:17:26.722329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <alias name="ua-0c778dd6-5d13-438a-85d2-05e1375c8694"/>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <serial>0c778dd6-5d13-438a-85d2-05e1375c8694</serial>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:26.722329 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:26.728820 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully detached device vdb from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the persistent domain config.
May 26 05:17:26.728969 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] (1/8): Attempting to detach device vdb with device alias ua-0c778dd6-5d13-438a-85d2-05e1375c8694 from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:17:26.729182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <alias name="ua-0c778dd6-5d13-438a-85d2-05e1375c8694"/>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <serial>0c778dd6-5d13-438a-85d2-05e1375c8694</serial>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:26.729182 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:26.856089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.239s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:26.903715 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 35df698f-2a48-4603-b3a8-9e71b2a47b46
May 26 05:17:27.203735 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772647.2033744, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => ua-0c778dd6-5d13-438a-85d2-05e1375c8694> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:17:27.205464 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-0c778dd6-5d13-438a-85d2-05e1375c8694 for instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:17:27.207681 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully detached device vdb from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the live domain config.
May 26 05:17:27.208851 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:27.209142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:27.209307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:27.209777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:27.210044 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0c778dd6-5d13-438a-85d2-05e1375c8694', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:27.210154 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:27.236438 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [189] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [190] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694 (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:27.236826 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '189'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '190'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:27.236826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '189')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:27.237587 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694', '190')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:27.238318 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46eb420>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:27.238479 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Removing multipathed devices sdi, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:27.238684 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Flush multipath device 33000000004b7ff7c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:27.272952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:27.307946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:27.321867 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:27.362507 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:27.362693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:27.364561 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:27.375481 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:27.375672 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:27.389289 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.420306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 189, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.40.100,3260]
May 26 05:17:27.420306 np0000001388 nova-compute[98319]: Logout of [sid: 189, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.40.100,3260] successful.
May 26 05:17:27.420306 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.436423 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.449013 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.493330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 190, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.50.100,3260]
May 26 05:17:27.493330 np0000001388 nova-compute[98319]: Logout of [sid: 190, target: iqn.2023-03.storpool.com:os--volume-0c778dd6-5d13-438a-85d2-05e1375c8694, portal: 192.168.50.100,3260] successful.
May 26 05:17:27.493330 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.509331 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:27.509563 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:27.509640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== disconnect_volume: return (300ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:27.509754 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:27.737857 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:27.911534 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9c8bb01a-62c1-4e3e-9118-b6bab886df32 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "35df698f-2a48-4603-b3a8-9e71b2a47b46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.950s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:28.054609 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:29.061417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d9cb8e31-4096-4b71-8b13-5e6b0a2b5e65 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.881s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:32.309564 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:32.618892 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:32.619355 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:32.739458 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:33.670278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:33.670660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:33.773908 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:33.774048 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:33.979990 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004081719998794142 future=<Future at 0x7d7ac4664530 state=cancelled>) was cancelled during its delay period, skipping {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:33.980124 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:33.980194 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.5530758810000407 future=<Future at 0x7d7aa4257ce0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:33.980426 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=3.5529527300000154 future=<Future at 0x7d7aa4257ce0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:34.173359 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:17:34.276225 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Detaching volume 967856b9-1bcb-482a-814a-d92f239d900f
May 26 05:17:34.327254 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Attempting to driver detach volume 967856b9-1bcb-482a-814a-d92f239d900f from mountpoint /dev/vdc
May 26 05:17:34.331908 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found disk vdc by alias ua-967856b9-1bcb-482a-814a-d92f239d900f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:34.333086 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Found disk vdc by alias ua-967856b9-1bcb-482a-814a-d92f239d900f {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:34.333256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Attempting to detach device vdc from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:17:34.333507 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <alias name="ua-967856b9-1bcb-482a-814a-d92f239d900f"/>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <serial>967856b9-1bcb-482a-814a-d92f239d900f</serial>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:34.333507 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:34.341886 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully detached device vdc from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the persistent domain config.
May 26 05:17:34.342009 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] (1/8): Attempting to detach device vdc with device alias ua-967856b9-1bcb-482a-814a-d92f239d900f from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:17:34.342309 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <alias name="ua-967856b9-1bcb-482a-814a-d92f239d900f"/>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <serial>967856b9-1bcb-482a-814a-d92f239d900f</serial>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:34.342309 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:34.617768 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:34.618011 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:34.618122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:17:34.618405 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:34.718795 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:34.719120 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:34.722473 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:17:34.722621 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Claim successful on node np0000001388
May 26 05:17:34.851808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772654.8514965, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => ua-967856b9-1bcb-482a-814a-d92f239d900f> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:17:34.853095 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-967856b9-1bcb-482a-814a-d92f239d900f for instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:17:34.855072 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully detached device vdc from instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f from the live domain config.
May 26 05:17:34.856002 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:34.856350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:34.856532 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:34.856874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:34.857165 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '967856b9-1bcb-482a-814a-d92f239d900f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:34.857356 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:34.887888 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: tcp: [193] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: tcp: [194] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f (non-flash)
May 26 05:17:34.888187 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:34.888187 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '193'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:34.888540 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '193')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:34.889378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f', '194')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:34.890097 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4442e80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:34.890354 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Removing multipathed devices sdk, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:34.890605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Flush multipath device 33000000082f3585a {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:34.917749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:34.970750 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:35.012785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:35.012959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:35.013880 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:35.024839 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:35.025138 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:35.035766 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.065167 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 193, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.40.100,3260]
May 26 05:17:35.065167 np0000001388 nova-compute[98319]: Logout of [sid: 193, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.40.100,3260] successful.
May 26 05:17:35.065167 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.080150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.090820 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.121153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 194, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.50.100,3260]
May 26 05:17:35.121153 np0000001388 nova-compute[98319]: Logout of [sid: 194, target: iqn.2023-03.storpool.com:os--volume-967856b9-1bcb-482a-814a-d92f239d900f, portal: 192.168.50.100,3260] successful.
May 26 05:17:35.121153 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.134624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:35.134846 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:35.134978 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== disconnect_volume: return (278ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:35.135109 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:35.501130 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:35.501480 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:35.617572 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:35.617821 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:35.679187 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'flavor' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:35.943144 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:17:35.943608 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:17:36.445653 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:17:36.617565 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:36.617846 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:36.685466 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3fd3adc7-5858-4f42-bb68-b8dd7c429c80 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.911s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:36.952305 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.233s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:36.952793 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing instance network info cache due to event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00031926199972076574 future=<Future at 0x7d7aa4257ce0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772642.5332162, 35df698f-2a48-4603-b3a8-9e71b2a47b46 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] VM Stopped (Lifecycle Event)
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing instance network info cache due to event network-changed-37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] Acquiring lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:37.925138 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:37.959408 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:37.962315 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:17:38.019830 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Successfully created port: 8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:17:38.036717 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 35df698f-2a48-4603-b3a8-9e71b2a47b46] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:38.089883 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updated VIF entry in instance network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:38.090786 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:38.179409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:38.179505 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:38.179671 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:38.179732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:38.179973 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:38.182010 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Terminating instance
May 26 05:17:38.451016 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Successfully updated port: 8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:17:38.466063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:17:38.592267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0b7bcfac-b609-4dc0-8fb3-cae0514239dd req-275ffcc2-c751-4280-96b5-30777a6e84bd service nova] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:38.592512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] Acquired lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:38.592718 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Refreshing network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:38.684491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:17:38.698894 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:38.715148 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:38.721087 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:38.738799 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:38.745764 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:38.952711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:38.952814 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:38.953026 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:17:38.969634 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Booting with volume snapshot 4907095a-cabc-4fec-bf87-9826c8ef96fe at /dev/vda
May 26 05:17:38.995975 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999633292999988 future=<Future at 0x7d7aa44339e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:38.996460 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999164805999953 future=<Future at 0x7d7aa44339e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:38.996516 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998813337000229 future=<Future at 0x7d7aa44339e0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:38.997496 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Instance destroyed successfully.
May 26 05:17:38.998020 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lazy-loading 'resources' on Instance uuid 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:39.094878 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:39.192676 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Received event network-changed-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:39.193029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Refreshing instance network info cache due to event network-changed-8ea26de3-82ee-4003-8fd1-11d9d700d34e. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:39.193186 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] Acquiring lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:39.356794 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:39.467789 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updated VIF entry in instance network info cache for port 37f81a2d-6d2e-449e-a088-c1c24222a07a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:39.468078 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [{"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:39.500424 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-server-240630702',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testinstanceswithcindervolumes-server-240630702',id=67,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsgPtOUd9911qY9Z6IMvNRZKeUAYXhrc5TyK0vkhboy+gLi2vxYZMpovPQJDPh5u3AkemeYWxxmo5HWPkU+o/GDPRQnRbGc+75rygDEhZOqnX18IqH0KedM1ZshdUn9mQ==',key_name='tempest-TestInstancesWithCinderVolumes-903301612',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:25Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f0f3c957b6c74be39b5af571c5d499a9',ramdisk_id='',reservation_id='r-c3ym0x9f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_signature_verified='False',owner_project_name='tempest-TestInstancesWithCinderVolumes-1793421881',owner_user_name='tempest-TestInstancesWithCinderVolumes-1793421881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:16:25Z,user_data=None,user_id='c37fe18037cb4b90bf4c0a076bddd23a',uuid=3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:17:39.500620 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converting VIF {"id": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "address": "fa:16:3e:2c:7d:6e", "network": {"id": "7ea99a16-11a8-48f4-b7a1-5a100efd3963", "bridge": "br-int", "label": "tempest-TestInstancesWithCinderVolumes-783806494-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.46", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f0f3c957b6c74be39b5af571c5d499a9", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap37f81a2d-6d", "ovs_interfaceid": "37f81a2d-6d2e-449e-a088-c1c24222a07a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:39.501228 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:39.501509 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:17:39.502607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.502607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37f81a2d-6d, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:39.503488 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.504216 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:39.504981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.505084 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.505269 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4a965bd-484b-4205-ba54-b44cd32b76f6) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:39.505731 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.506213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:39.506521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:39.507902 np0000001388 nova-compute[98319]: INFO os_vif [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2c:7d:6e,bridge_name='br-int',has_traffic_filtering=True,id=37f81a2d-6d2e-449e-a088-c1c24222a07a,network=Network(7ea99a16-11a8-48f4-b7a1-5a100efd3963),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37f81a2d-6d')
May 26 05:17:39.509163 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:39.509441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:39.509550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:39.509809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:39.510025 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd437ee4e-4adb-4130-9727-3206d3b322d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:39.510131 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:39.523668 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:17:39.531901 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:39.531901 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:39.531901 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:39.531901 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:39.531901 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:39.532040 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsi session list stdout=tcp: [185] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:39.532040 np0000001388 nova-compute[98319]: tcp: [186] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4 (non-flash)
May 26 05:17:39.532040 np0000001388 nova-compute[98319]: tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:39.532040 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:39.532040 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:39.532145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Sessions list: [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:39.532224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '186')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:39.532890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4', '185')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:39.533545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43e0c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'): ({'sdg'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'): ({'sdf'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:39.533726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:39.533913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Flush multipath device 33000000018bb6d33 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:39.588559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:39.617605 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:39.637647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:39.666712 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:39.666858 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:39.666992 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:39.667096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:39.667232 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] No waiting events found dispatching network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:39.667379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:17:39.667523 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:39.667676 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Acquiring lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:39.667838 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:39.667976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:39.668129 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] No waiting events found dispatching network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:39.668300 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ea9949af-5c9f-4608-9481-1949268bed61 req-480d7b66-a482-414d-b220-b4ea93093ab2 service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-unplugged-37f81a2d-6d2e-449e-a088-c1c24222a07a for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:17:39.673166 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:39.687517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:39.687654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:39.688252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:39.699252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:39.699413 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:39.710067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.740896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 186, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.40.100,3260]
May 26 05:17:39.740896 np0000001388 nova-compute[98319]: Logout of [sid: 186, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.40.100,3260] successful.
May 26 05:17:39.740896 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.753281 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.765066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.787773 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Updating instance_info_cache with network_info: [{"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:39.791098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 185, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.50.100,3260]
May 26 05:17:39.791098 np0000001388 nova-compute[98319]: Logout of [sid: 185, target: iqn.2023-03.storpool.com:os--volume-d437ee4e-4adb-4130-9727-3206d3b322d4, portal: 192.168.50.100,3260] successful.
May 26 05:17:39.791098 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.802835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:39.802835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:39.802835 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] <== disconnect_volume: return (293ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:39.802835 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:39.803053 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Deleting instance files /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f_del
May 26 05:17:39.803721 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Deletion of /opt/stack/data/nova/instances/3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f_del complete
May 26 05:17:39.970069 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca5fad4-1745-4716-b533-828a3a4961ee req-897480fc-fa9d-4ac7-863b-6aaa77738e5f service nova] Releasing lock "refresh_cache-3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:40.121800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:40.122058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:40.122238 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:40.122427 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:17:40.289677 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:40.289884 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Instance network_info: |[{"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:17:40.290298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] Acquired lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:40.290460 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Refreshing network info cache for port 8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:40.308900 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Took 1.62 seconds to destroy the instance on the hypervisor.
May 26 05:17:40.309853 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:17:40.310259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:17:40.310343 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:17:40.310555 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:40.399922 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:40.792630 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:41.069101 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:41.096645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:41.143393 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:41.191590 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Updated VIF entry in instance network info cache for port 8ea26de3-82ee-4003-8fd1-11d9d700d34e. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:41.191981 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Updating instance_info_cache with network_info: [{"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:41.229991 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:41.230428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:41.313823 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:41.314270 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:17:41.317731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:41.404905 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:41.405806 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:41.491344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:41.494018 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Error from libvirt while getting description of instance-00000043: [Error Code 42] Domain not found: no domain with matching uuid '3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f' (instance-00000043): libvirt.libvirtError: Domain not found: no domain with matching uuid '3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f' (instance-00000043)
May 26 05:17:41.495652 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:17:41.496640 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:41.540942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:41.541449 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13621MB free_disk=72.5736198425293GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:17:41.541635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:41.541948 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:41.598755 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Took 1.29 seconds to deallocate network for instance.
May 26 05:17:41.694822 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f6f9a8a3-ff99-4c82-a1f1-8360728fd971 req-8d72a39f-c5ce-467c-9064-650c3e6a8db8 service nova] Releasing lock "refresh_cache-0c35467a-0043-41cb-9f25-2d7f4eff3605" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:41.725205 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-31ef7539-3fce-4279-8f0b-8760c82f70dc req-fee1499e-9be1-4b38-b000-656fef4f3e7d service nova] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Received event network-vif-deleted-37f81a2d-6d2e-449e-a088-c1c24222a07a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:41.897664 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:42.140163 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:17:42.339568 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:42.351976 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:17:42.372178 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:42.414999 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:17:42.415256 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:17:42.423753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:17:42.424725 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fefe:2893', 'fe80::cfa:15ff:febe:944a'] 
May 26 05:17:42.424884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:17:42.425024 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:17:42.425333 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (85ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:42.425608 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Updating existing volume attachment record: 8a80af65-707d-4172-81a8-bdd89ee7a343 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:17:42.603218 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:17:42.603218 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 92063d97-0979-4e77-bba2-fbdd8a98d30d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:17:42.603218 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 25b52548-45d5-4109-bd5b-d7851c560095 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:17:42.603218 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 0c35467a-0043-41cb-9f25-2d7f4eff3605 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:17:42.603218 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:17:42.603621 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1280MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:17:41 up 49 min,  2 users,  load average: 3.68, 4.70, 4.54\n', 'num_instances': '4', 'num_vm_active': '3', 'num_task_None': '2', 'num_os_type_None': '4', 'num_proj_a2daf4310913422fa7ec23fe1a468a39': '1', 'io_workload': '1', 'num_proj_56542810ab5d4dd9b443231e8931b871': '1', 'num_vm_building': '1', 'num_task_block_device_mapping': '1', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1', 'num_task_deleting': '1', 'num_proj_f0f3c957b6c74be39b5af571c5d499a9': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:17:42.649214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:42.767507 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:42.804939 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:17:42.806920 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:17:43.311312 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:17:43.818611 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:17:43.819008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.277s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:43.819573 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:43.819774 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:44.021903 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:17:44.022132 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:17:44.507583 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:44.521020 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:17:44.522007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:17:44.522273 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Creating image(s)
May 26 05:17:44.522542 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:17:44.522654 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Ensure instance console log exists: /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:17:44.522853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:44.523042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:44.523165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:44.523611 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Start _get_guest_xml network_info=[{"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '8a80af65-707d-4172-81a8-bdd89ee7a343', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '0c35467a-0043-41cb-9f25-2d7f4eff3605', 'attached_at': '', 'detached_at': '', 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'serial': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:17:44.524729 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:17:44.530336 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:17:44.531243 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1402096315', uuid='0c35467a-0043-41cb-9f25-2d7f4eff3605'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772664.5309417) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:17:44.532390 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:17:44.532696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:17:44.533700 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:17:44.533862 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:17:44.534743 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:17:44.534980 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:17:44.535132 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:17:44.535259 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:17:44.535451 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:17:44.535572 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:17:44.535720 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:17:44.535871 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:17:44.536019 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:17:44.536123 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:17:44.536241 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:17:44.536353 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:17:44.547957 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:17:44.548304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:44.548448 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:44.548760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:44.548968 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:17:44.559957 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:44.560486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:44.560859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:44.561117 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:44.561385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:44.561560 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:44.572823 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:44.572823 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:44.578023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:44.578023 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:44.587803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4] added
May 26 05:17:44.587803 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:44.587803 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:44.587803 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:44.587803 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:44.587803 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:44.587803 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:44.587999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:44.588145 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0271(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:44.588320 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:44.591665 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4] added
May 26 05:17:44.591665 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:44.591665 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:44.591665 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:44.591665 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:44.591665 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:44.591665 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:44.591838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:44.591953 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0304(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:44.592080 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:45.031009 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.212s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:45.078378 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Deleted allocations for instance 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f
May 26 05:17:45.589214 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:45.592495 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:45.603900 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:45.603900 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:45.609959 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:45.609959 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.616760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.621787 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.631216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.631216 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.631216 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:45.631392 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.631392 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.631392 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:45.636049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.636049 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.636049 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:45.636158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.636158 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.636158 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:45.668537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.40.100,3260]
May 26 05:17:45.668537 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.40.100,3260] successful.
May 26 05:17:45.668537 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.683227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.683900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.50.100,3260]
May 26 05:17:45.683900 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.50.100,3260] successful.
May 26 05:17:45.683900 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.697457 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.697457 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.697457 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.697457 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.697457 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:45.697755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:45.697923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.697923 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.697923 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.697923 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.697923 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:45.698350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:45.698350 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:45.700877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 195 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:45.700877 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:45.717126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 195 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:45.717304 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:45.718466 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.718466 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.718466 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.718466 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.718466 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:45.718620 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.718620 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:45.718620 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.718620 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:45.718620 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:45.718864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:45.718994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:45.719548 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 196 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:45.719707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:45.735607 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 196 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:45.735749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:46.086382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-f43aa2dc-1e24-4df2-85ed-c71c7f3d1c86 tempest-TestInstancesWithCinderVolumes-1793421881 tempest-TestInstancesWithCinderVolumes-1793421881-project-member] Lock "3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.907s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:46.561653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:17:47.575429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 330000000cc73a3f5 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:17:47.575998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.027s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:47.575998 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3027ms) {'type': 'block', 'scsi_wwn': '330000000cc73a3f5', 'path': '/dev/dm-0', 'multipath_id': '330000000cc73a3f5'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:47.575998 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cc73a3f5', 'path': '/dev/dm-0', 'multipath_id': '330000000cc73a3f5'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:17:47.769250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:47.819875 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:47.820083 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:17:47.820347 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.80 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:17:48.080514 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1402096315',display_name='tempest-TestVolumeBootPattern-server-1402096315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1402096315',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-6uksnmgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:17:38Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=0c35467a-0043-41cb-9f25-2d7f4eff3605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:17:48.080710 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:48.081212 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:48.081754 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c35467a-0043-41cb-9f25-2d7f4eff3605 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:48.584737 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] End _get_guest_xml xml=<domain type="qemu">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <uuid>0c35467a-0043-41cb-9f25-2d7f4eff3605</uuid>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <name>instance-00000046</name>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-1402096315</nova:name>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:17:44</nova:creationTime>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         <nova:port uuid="8ea26de3-82ee-4003-8fd1-11d9d700d34e">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <system>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="serial">0c35467a-0043-41cb-9f25-2d7f4eff3605</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="uuid">0c35467a-0043-41cb-9f25-2d7f4eff3605</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </system>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <os>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </os>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <features>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </features>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   <devices>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/disk.config"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <alias name="ua-fc61fa91-369a-45e9-aec2-e5a6d51170d4"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <serial>fc61fa91-369a-45e9-aec2-e5a6d51170d4</serial>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </disk>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:26:52:ca"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <target dev="tap8ea26de3-82"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </interface>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/console.log" append="off"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </serial>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <video>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </video>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </rng>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:   </devices>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]: </domain>
May 26 05:17:48.584737 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Preparing to wait for external event network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1402096315',display_name='tempest-TestVolumeBootPattern-server-1402096315',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1402096315',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-6uksnmgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:17:38Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=0c35467a-0043-41cb-9f25-2d7f4eff3605,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:17:48.586964 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:48.587385 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:48.587741 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:17:48.588031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.588257 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:48.588512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:17:48.589876 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.590047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1fff48c-6844-5c9c-86f1-4867cdc59e84', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:48.609267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.610536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:48.612365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.612522 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea26de3-82, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:48.612809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8ea26de3-82, col_values=(('qos', UUID('102da1d1-3c8e-4d75-a98f-1a0c0a35bf04')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:48.612961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8ea26de3-82, col_values=(('external_ids', {'iface-id': '8ea26de3-82ee-4003-8fd1-11d9d700d34e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:52:ca', 'vm-uuid': '0c35467a-0043-41cb-9f25-2d7f4eff3605'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:48.613803 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.614750 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:48.619906 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:48.620865 np0000001388 nova-compute[98319]: INFO os_vif [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82')
May 26 05:17:49.729209 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:50.135366 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:50.135513 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:50.135616 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:26:52:ca, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:17:50.135943 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Using config drive
May 26 05:17:50.640857 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:50.748539 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Creating config drive at /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/disk.config
May 26 05:17:50.751516 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6166aj14 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:50.819767 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6166aj14" returned: 0 in 0.068s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:17:51.197746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.221127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.298734 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.390451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:51.391641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:51.537325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.539320 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.541080 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.542237 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.558597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.609646 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2a686c6-8a63-466a-b501-911dbbe577f0 req-595b1331-66ed-4899-a615-8e87da1c20f0 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Received event network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:51.609800 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2a686c6-8a63-466a-b501-911dbbe577f0 req-595b1331-66ed-4899-a615-8e87da1c20f0 service nova] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:51.610253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2a686c6-8a63-466a-b501-911dbbe577f0 req-595b1331-66ed-4899-a615-8e87da1c20f0 service nova] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:51.610253 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e2a686c6-8a63-466a-b501-911dbbe577f0 req-595b1331-66ed-4899-a615-8e87da1c20f0 service nova] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:51.610333 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e2a686c6-8a63-466a-b501-911dbbe577f0 req-595b1331-66ed-4899-a615-8e87da1c20f0 service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Processing event network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:17:51.849478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:51.897027 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:51.905122 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772671.904695, 0c35467a-0043-41cb-9f25-2d7f4eff3605 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:51.905780 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:17:51.906262 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] VM Started (Lifecycle Event)
May 26 05:17:51.908720 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:17:51.911646 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Instance spawned successfully.
May 26 05:17:51.912208 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:17:52.409303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:52.411443 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:52.420079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.420300 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.421676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.422921 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.423522 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.424673 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:17:52.772282 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:52.905068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.513s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:52.913738 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:17:52.913999 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772672.913834, 0c35467a-0043-41cb-9f25-2d7f4eff3605 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:52.914127 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] VM Paused (Lifecycle Event)
May 26 05:17:52.930986 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Took 8.41 seconds to spawn the instance on the hypervisor.
May 26 05:17:52.930986 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:53.416654 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:53.418827 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772673.4184306, 0c35467a-0043-41cb-9f25-2d7f4eff3605 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:53.418827 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] VM Resumed (Lifecycle Event)
May 26 05:17:53.439481 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Took 18.76 seconds to build instance.
May 26 05:17:53.614684 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:53.678015 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Received event network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:53.678261 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:53.678451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:53.678619 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:53.678762 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] No waiting events found dispatching network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:17:53.678905 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0e50a98b-8c70-401d-a24a-384bab562f5e req-89983344-316e-4eac-b871-e1d91d60a1df service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Received unexpected event network-vif-plugged-8ea26de3-82ee-4003-8fd1-11d9d700d34e for instance with vm_state active and task_state None.
May 26 05:17:53.921320 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:53.923114 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:17:53.942032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2461d7f4-5e7f-4639-8e00-2f65fb833e8f tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.271s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:53.995896 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005080359997009509 future=<Future at 0x7d7aa44339e0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:53.996025 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:53.996386 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772658.9952476, 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:17:53.996542 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] VM Stopped (Lifecycle Event)
May 26 05:17:54.081672 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:54.081880 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:54.082044 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attaching volume 61682cd4-1542-4b89-a33e-82b32f9a2f48 to /dev/vdb
May 26 05:17:54.124504 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:54.141229 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:17:54.170600 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:17:54.226092 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:17:54.226510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:17:54.237416 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:17:54.238901 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fefe:2893', 'fe80::cfa:15ff:febe:944a', 'fe80::fc16:3eff:fe26:52ca', 'fe80::5ca0:c8ff:fef8:5735'] 
May 26 05:17:54.239117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:17:54.239313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:17:54.239685 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:54.240021 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating existing volume attachment record: 3fdc1a9e-b06a-4672-82c2-340a3dd02c84 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:17:54.500047 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 3a9c05b8-62b9-4f77-bffc-3f3eb9bcd77f] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:17:54.797550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:17:54.798597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:54.798597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:54.798597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:54.798808 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:17:54.812647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:54.813344 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:54.813673 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:54.815314 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:54.815314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:54.815314 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:54.825554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:54.825554 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:54.830847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:17:54.830847 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:54.838690 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48] added
May 26 05:17:54.838690 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:54.838690 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:54.838690 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:54.838690 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:54.838690 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:54.838690 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:54.838912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:54.839044 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0251(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:54.839189 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:54.843911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48] added
May 26 05:17:54.843911 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:17:54.843911 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:54.843911 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:54.843911 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:17:54.843911 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:17:54.843911 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:54.844250 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:17:54.844292 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:17:54.844433 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:17:55.366774 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:55.367259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:55.367259 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:55.367355 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:55.367515 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:17:55.370025 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Terminating instance
May 26 05:17:55.841391 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:55.860623 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:55.860623 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:17:55.868690 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:17:55.868690 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.873018 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:17:55.874235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.879779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.890235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.890235 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.890235 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.890235 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.890235 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:55.891346 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.891346 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.891346 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.891346 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.891346 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.898678 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:55.910229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:55.925863 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:55.926958 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:55.939862 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.40.100,3260]
May 26 05:17:55.939862 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.40.100,3260] successful.
May 26 05:17:55.939862 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.948687 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:55.952354 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.953793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.50.100,3260]
May 26 05:17:55.953793 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.50.100,3260] successful.
May 26 05:17:55.953793 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.967731 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.969274 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.154s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('11', '-', '-', 0) found on session 197 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:55.969274 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:55.972912 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:55.983833 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 197 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:55.983986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.994810 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:55.994947 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:55.995171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.181s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:55.995296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:17:55.995956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('12', '-', '-', 0) found on session 198 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:17:55.996081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:17:56.013249 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 198 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:17:56.013596 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:17:56.205259 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999619566999627 future=<Future at 0x7d7aa43aa3f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:56.205623 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999250224999741 future=<Future at 0x7d7aa43aa3f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:56.206094 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998735229999966 future=<Future at 0x7d7aa43aa3f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:17:56.206903 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Instance destroyed successfully.
May 26 05:17:56.206903 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 0c35467a-0043-41cb-9f25-2d7f4eff3605 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:56.710886 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:17:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1402096315',display_name='tempest-TestVolumeBootPattern-server-1402096315',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1402096315',id=70,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:17:52Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-6uksnmgy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:53Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=0c35467a-0043-41cb-9f25-2d7f4eff3605,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:17:56.711406 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "address": "fa:16:3e:26:52:ca", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea26de3-82", "ovs_interfaceid": "8ea26de3-82ee-4003-8fd1-11d9d700d34e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:17:56.711578 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:17:56.711810 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:17:56.713161 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.714223 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea26de3-82, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:56.714413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.715435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:56.716158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.716802 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.716961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=102da1d1-3c8e-4d75-a98f-1a0c0a35bf04) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:17:56.717462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.718030 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:17:56.718335 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:56.719963 np0000001388 nova-compute[98319]: INFO os_vif [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:52:ca,bridge_name='br-int',has_traffic_filtering=True,id=8ea26de3-82ee-4003-8fd1-11d9d700d34e,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea26de3-82')
May 26 05:17:56.721655 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:56.721953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:56.722071 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:56.814876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:17:57.779387 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:57.783063 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:57.783135 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing instance network info cache due to event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:57.783360 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:57.783498 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:57.784111 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:57.829753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found WWN 330000000ebce8908 for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:17:57.830001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.031s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:57.830151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000ebce8908', 'path': '/dev/dm-4', 'multipath_id': '330000000ebce8908'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:57.830296 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ebce8908', 'path': '/dev/dm-4', 'multipath_id': '330000000ebce8908'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:17:57.830752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.109s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:57.831158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'fc61fa91-369a-45e9-aec2-e5a6d51170d4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:57.831348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:57.833074 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:57.856916 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: tcp: [195] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: tcp: [196] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:57.857118 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:57.857386 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', '195'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', '196'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:57.857386 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', '195')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:57.858183 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4', '196')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:57.859257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46c91c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:57.859257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:57.859257 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 330000000cc73a3f5 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:57.933900 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:57.984473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:58.007035 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:17:58.030890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:17:58.031165 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:17:58.031881 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:17:58.043499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:17:58.043777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:17:58.055787 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.085190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 195, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.40.100,3260]
May 26 05:17:58.085190 np0000001388 nova-compute[98319]: Logout of [sid: 195, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.40.100,3260] successful.
May 26 05:17:58.085190 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.100599 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.111657 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.142155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 196, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.50.100,3260]
May 26 05:17:58.142155 np0000001388 nova-compute[98319]: Logout of [sid: 196, target: iqn.2023-03.storpool.com:os--volume-fc61fa91-369a-45e9-aec2-e5a6d51170d4, portal: 192.168.50.100,3260] successful.
May 26 05:17:58.142155 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.155295 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:17:58.155525 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:17:58.155680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (1434ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:17:58.155802 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:17:58.156064 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Deleting instance files /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605_del
May 26 05:17:58.156551 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Deletion of /opt/stack/data/nova/instances/0c35467a-0043-41cb-9f25-2d7f4eff3605_del complete
May 26 05:17:58.286111 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:58.335696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to attach volume 61682cd4-1542-4b89-a33e-82b32f9a2f48 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:17:58.337032 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:   <alias name="ua-61682cd4-1542-4b89-a33e-82b32f9a2f48"/>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:   <serial>61682cd4-1542-4b89-a33e-82b32f9a2f48</serial>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:58.337032 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:17:58.662649 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Took 2.79 seconds to destroy the instance on the hypervisor.
May 26 05:17:58.663507 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:17:58.663801 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:17:58.663907 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:17:58.664115 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:58.737109 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:58.742658 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:17:58.818645 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:17:58.819026 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:17:58.879791 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updated VIF entry in instance network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:17:58.880111 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:59.321094 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Detaching volume b868d915-864c-4f95-901c-d632a5fd07d6
May 26 05:17:59.358303 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Attempting to driver detach volume b868d915-864c-4f95-901c-d632a5fd07d6 from mountpoint /dev/vdb
May 26 05:17:59.362508 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found disk vdb by alias ua-b868d915-864c-4f95-901c-d632a5fd07d6 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:59.363648 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Found disk vdb by alias ua-b868d915-864c-4f95-901c-d632a5fd07d6 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:17:59.363805 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Attempting to detach device vdb from instance 92063d97-0979-4e77-bba2-fbdd8a98d30d from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:17:59.364061 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <alias name="ua-b868d915-864c-4f95-901c-d632a5fd07d6"/>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <serial>b868d915-864c-4f95-901c-d632a5fd07d6</serial>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:59.364061 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:59.370117 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully detached device vdb from instance 92063d97-0979-4e77-bba2-fbdd8a98d30d from the persistent domain config.
May 26 05:17:59.370287 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] (1/8): Attempting to detach device vdb with device alias ua-b868d915-864c-4f95-901c-d632a5fd07d6 from instance 92063d97-0979-4e77-bba2-fbdd8a98d30d from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:17:59.370556 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <alias name="ua-b868d915-864c-4f95-901c-d632a5fd07d6"/>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-1"/>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <serial>b868d915-864c-4f95-901c-d632a5fd07d6</serial>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]: </disk>
May 26 05:17:59.370556 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:17:59.381998 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-630c5a05-f480-4506-9f68-d6c77d70e87a req-d376c6e9-582c-4d99-84b3-b6b67092fd7e service nova] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:17:59.456182 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:17:59.843219 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:17:59.843578 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing instance network info cache due to event network-changed-978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:17:59.843578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] Acquiring lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:17:59.843578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] Acquired lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:17:59.843701 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Refreshing network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:17:59.901180 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772679.9008427, 92063d97-0979-4e77-bba2-fbdd8a98d30d => ua-b868d915-864c-4f95-901c-d632a5fd07d6> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:17:59.901824 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-b868d915-864c-4f95-901c-d632a5fd07d6 for instance 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:17:59.903711 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully detached device vdb from instance 92063d97-0979-4e77-bba2-fbdd8a98d30d from the live domain config.
May 26 05:17:59.904531 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:17:59.904797 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:17:59.904910 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:17:59.905208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:17:59.905461 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b868d915-864c-4f95-901c-d632a5fd07d6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:17:59.905605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:17:59.928551 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:59.928551 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:59.928551 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:59.928551 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:59.928551 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:17:59.928736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsi session list stdout=tcp: [187] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:59.928736 np0000001388 nova-compute[98319]: tcp: [188] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6 (non-flash)
May 26 05:17:59.928736 np0000001388 nova-compute[98319]: tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:59.928736 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:17:59.928736 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:17:59.928898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:17:59.928984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '187')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:59.929938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6', '188')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:17:59.930671 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4464360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:17:59.930836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:17:59.931043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Flush multipath device 330000000bbb57175 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:17:59.958014 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Took 1.29 seconds to deallocate network for instance.
May 26 05:17:59.962546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:17:59.997087 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:59.997348 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:59.997536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:17:59.997711 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:22:82:4b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:00.004765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:18:00.060511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:18:00.060668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:18:00.061312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:18:00.072086 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:18:00.072297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:18:00.082329 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.109234 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 187, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.40.100,3260]
May 26 05:18:00.109234 np0000001388 nova-compute[98319]: Logout of [sid: 187, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.40.100,3260] successful.
May 26 05:18:00.109234 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.125889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.136328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.169307 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 188, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.50.100,3260]
May 26 05:18:00.169307 np0000001388 nova-compute[98319]: Logout of [sid: 188, target: iqn.2023-03.storpool.com:os--volume-b868d915-864c-4f95-901c-d632a5fd07d6, portal: 192.168.50.100,3260] successful.
May 26 05:18:00.169307 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.180713 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:00.180883 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:00.180988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] <== disconnect_volume: return (276ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:00.181088 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:18:00.345955 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:00.383528 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:00.509639 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:18:00.511570 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Deleting volume: fc61fa91-369a-45e9-aec2-e5a6d51170d4 {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:18:00.656253 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:00.727343 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'flavor' on Instance uuid 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:00.817249 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updated VIF entry in instance network info cache for port 978a5c1d-6fa7-47e6-b35c-4c049234df7a. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:00.817647 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [{"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:00.924482 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:01.050272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:01.050458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:01.231235 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:01.231379 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:01.238539 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:01.319809 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] Releasing lock "refresh_cache-92063d97-0979-4e77-bba2-fbdd8a98d30d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:01.320012 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-9a8f2870-cd97-4e25-ae42-71ce5ab76c00 req-cc79e35f-2719-4d06-9e7f-acc79217f37a service nova] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Received event network-vif-deleted-8ea26de3-82ee-4003-8fd1-11d9d700d34e {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:01.547559 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-aa885106-96c5-4d48-9d4d-533c505b5dd1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.466s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:01.547983 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:01.719642 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:01.737078 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:01.742685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7156e61f-6398-4aac-9a12-fb1b530f670d tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.918s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:01.887485 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:02.052461 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:02.245930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.195s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:02.292372 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 0c35467a-0043-41cb-9f25-2d7f4eff3605
May 26 05:18:02.798790 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.058294 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:03.147839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:03.147839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:03.147839 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:03.148013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:03.148123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:03.150162 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Terminating instance
May 26 05:18:03.302234 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-17b3a175-54d5-480f-9860-f2acc08b06c3 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "0c35467a-0043-41cb-9f25-2d7f4eff3605" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.935s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:03.652924 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:18:03.666725 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.668072 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.682267 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.685150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.699662 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.704838 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.799736 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:03.799978 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:03.800240 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attaching volume 97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 to /dev/vdc
May 26 05:18:03.838122 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:03.850546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:18:03.874799 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:03.926339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:18:03.926786 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:18:03.936054 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:18:03.937806 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca'] 
May 26 05:18:03.937932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:18:03.938433 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:18:03.938433 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== get_connector_properties: return (99ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:03.938596 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating existing volume attachment record: d513c6dd-75e9-49ca-9caf-8c1f6403964b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:18:03.953832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.981148 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.983426 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:03.987169 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99968582099973 future=<Future at 0x7d7aa437a990 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:03.989279 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Instance destroyed successfully.
May 26 05:18:03.989392 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lazy-loading 'resources' on Instance uuid 92063d97-0979-4e77-bba2-fbdd8a98d30d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:03.998510 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.260283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.266812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.269300 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.291717 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.297905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.380985 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.404974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.494313 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1429894149',display_name='tempest-TestMinimumBasicScenario-server-1429894149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testminimumbasicscenario-server-1429894149',id=68,image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLUYNhYpIfhqYJOn7TxkVObeLSKPBK9S6k8IWORqqcvi9tXvSV6OXywzOD+IY79M3iD37oeRA7wxstb1Q+W2s1AhCz3POmX+MXM0qqtEiX3Ys8hyiO1VXuotk4R0ZnID9w==',key_name='tempest-TestMinimumBasicScenario-463261503',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:16:44Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2daf4310913422fa7ec23fe1a468a39',ramdisk_id='',reservation_id='r-lmnges2b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='252cbd3e-9981-49e2-9887-d01f71609b05',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-2112472404',owner_user_name='tempest-TestMinimumBasicScenario-2112472404-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:21Z,user_data=None,user_id='b515a0ad4e5e46bdb9b8ef1590088c49',uuid=92063d97-0979-4e77-bba2-fbdd8a98d30d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:18:04.494736 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converting VIF {"id": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "address": "fa:16:3e:fe:28:93", "network": {"id": "b94ed4e3-77a5-4a4f-8285-6738a244850f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1559460758-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a2daf4310913422fa7ec23fe1a468a39", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap978a5c1d-6f", "ovs_interfaceid": "978a5c1d-6fa7-47e6-b35c-4c049234df7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:04.496685 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:04.496685 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:18:04.498162 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.498325 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap978a5c1d-6f, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:04.499598 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.500101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:04.500607 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.501292 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.501412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12aad209-bf16-41ba-845d-16fb1d0da752) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:04.501974 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.502674 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:04.502731 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:04.504476 np0000001388 nova-compute[98319]: INFO os_vif [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:28:93,bridge_name='br-int',has_traffic_filtering=True,id=978a5c1d-6fa7-47e6-b35c-4c049234df7a,network=Network(b94ed4e3-77a5-4a4f-8285-6738a244850f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap978a5c1d-6f')
May 26 05:18:04.504784 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Deleting instance files /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d_del
May 26 05:18:04.506006 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Deletion of /opt/stack/data/nova/instances/92063d97-0979-4e77-bba2-fbdd8a98d30d_del complete
May 26 05:18:04.516342 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '25b52548-45d5-4109-bd5b-d7851c560095', 'attached_at': '', 'detached_at': '', 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'serial': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:18:04.517894 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:18:04.518288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:04.518456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:04.518878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:04.519108 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:18:04.532338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:04.533041 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:04.534018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:04.534266 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:04.534863 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:04.534968 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:04.545541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:04.545541 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:04.550406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:04.550406 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:04.557106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35] added
May 26 05:18:04.557106 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:04.557106 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:04.557106 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:04.557106 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:04.557106 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:04.557106 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:04.557407 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:04.557467 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:04.557638 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:04.561247 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35] added
May 26 05:18:04.561247 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:04.561247 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:04.561247 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:04.561247 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:04.561247 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:04.561247 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:04.561445 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:04.561565 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0266(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:04.561749 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:05.013273 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Took 1.36 seconds to destroy the instance on the hypervisor.
May 26 05:18:05.013849 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:18:05.014175 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:18:05.014344 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:18:05.014691 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:05.087974 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:05.340485 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2650f494-0ab6-4016-869a-13e698236605 req-e061769e-4319-4f40-ac69-f2d323fe6229 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Received event network-vif-deleted-978a5c1d-6fa7-47e6-b35c-4c049234df7a {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:05.340818 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-2650f494-0ab6-4016-869a-13e698236605 req-e061769e-4319-4f40-ac69-f2d323fe6229 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Neutron deleted interface 978a5c1d-6fa7-47e6-b35c-4c049234df7a; detaching it from the instance and deleting it from the info cache
May 26 05:18:05.340976 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-2650f494-0ab6-4016-869a-13e698236605 req-e061769e-4319-4f40-ac69-f2d323fe6229 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:05.558025 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:05.562182 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:05.570889 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:05.570889 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:05.576550 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:05.576550 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.581930 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.588971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.594801 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.594801 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.594801 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:05.594940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.594940 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.594940 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:05.601262 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.601262 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.601262 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:05.601378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.601378 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.601378 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:05.614468 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:05.614688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:05.631455 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.50.100,3260]
May 26 05:18:05.631455 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.50.100,3260] successful.
May 26 05:18:05.631455 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.644465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.650637 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.40.100,3260]
May 26 05:18:05.650637 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.40.100,3260] successful.
May 26 05:18:05.650637 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.658781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.658781 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.658781 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.658781 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.658781 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:05.658937 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.658937 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.658937 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.658937 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.658937 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:05.659244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.125s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:05.659405 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:05.660252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('7', '-', '-', 0) found on session 199 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:05.660383 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:05.665988 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:05.675772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 199 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:05.675772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:05.681721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.681721 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.681721 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.681721 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.681721 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:05.681897 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.681897 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:05.681897 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.681897 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:05.681897 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:05.682219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.148s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:05.682324 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:05.682874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('8', '-', '-', 0) found on session 200 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:05.682974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:05.697977 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 200 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:05.698125 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:05.799498 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:05.844075 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2650f494-0ab6-4016-869a-13e698236605 req-e061769e-4319-4f40-ac69-f2d323fe6229 service nova] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Detach interface failed, port_id=978a5c1d-6fa7-47e6-b35c-4c049234df7a, reason: Instance 92063d97-0979-4e77-bba2-fbdd8a98d30d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:18:06.116349 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:18:06.301586 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Took 1.29 seconds to deallocate network for instance.
May 26 05:18:06.534338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:18:06.664707 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:06.664932 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:06.667914 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:18:06.668191 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Claim successful on node np0000001388
May 26 05:18:06.806951 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:07.548559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found WWN 330000000cee9ae13 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:18:07.548916 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:07.549730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== connect_volume: return (3031ms) {'type': 'block', 'scsi_wwn': '330000000cee9ae13', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cee9ae13'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:07.549864 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cee9ae13', 'path': '/dev/disk/by-id/os-brick+dev+dm-0', 'multipath_id': '330000000cee9ae13'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:18:07.551633 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:18:07.551842 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:18:07.551979 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:18:07.571960 np0000001388 nova-compute[98319]: WARNING os_brick.encryptors.luks [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] isLuks exited abnormally (status 1): : oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
May 26 05:18:07.572249 np0000001388 nova-compute[98319]: WARNING stevedore.named [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Could not load nova.keymgr.conf_key_mgr.ConfKeyManager
May 26 05:18:07.572439 np0000001388 nova-compute[98319]: WARNING castellan.key_manager [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Deprecation Warning : nova.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:18:07.572606 np0000001388 nova-compute[98319]: WARNING nova.keymgr.conf_key_mgr [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'nova.keymgr.conf_key_mgr.ConfKeyManager'
May 26 05:18:07.573106 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Using volume encryptor '<os_brick.encryptors.luks.LuksEncryptor object at 0x7d7ac46bb590>' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '25b52548-45d5-4109-bd5b-d7851c560095', 'attached_at': '', 'detached_at': '', 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'serial': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'} {{(pid=98319) get_volume_encryptor /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:105}}
May 26 05:18:07.573288 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors.luks [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] formatting encrypted volume /dev/dm-0 {{(pid=98319) _format_luks_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/luks.py:140}}
May 26 05:18:07.809632 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:07.876296 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:07.876579 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:08.385799 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:08.596924 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:08.597434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:08.891739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.227s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:08.893419 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:18:08.894152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.087s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:09.099163 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:18:09.104457 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:09.104690 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:09.398355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:18:09.398594 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:18:09.399174 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:09.399399 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:09.482187 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5818c10abb5d4f01b76e07eabdde16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6588fb6c3894fadbc7f9ded9103be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:18:09.502142 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:09.606715 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:09.661837 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:09.901532 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:18:09.949059 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Successfully created port: d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:18:10.114411 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.220s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:10.116067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.453s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:10.118859 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:18:10.118969 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Claim successful on node np0000001388
May 26 05:18:10.179340 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Deleted allocations for instance 92063d97-0979-4e77-bba2-fbdd8a98d30d
May 26 05:18:10.404795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:18:10.408809 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Successfully updated port: d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:18:10.464159 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-changed-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:10.464301 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Refreshing instance network info cache due to event network-changed-d82473f7-9a25-41d3-8c57-8ecad78453dd. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:10.464444 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] Acquiring lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:10.464536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] Acquired lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:10.464653 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Refreshing network info cache for port d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:10.911413 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Booting with volume 19045b9f-cbc7-403b-84c0-d700e4df2b6c at /dev/vda
May 26 05:18:10.913188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:10.948624 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:10.959574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:18:10.967819 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:10.988233 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:11.036533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:18:11.036803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:18:11.045613 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:18:11.046594 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca'] 
May 26 05:18:11.046761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:18:11.046920 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:18:11.047176 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:11.047461 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating existing volume attachment record: 00133517-0eaf-4e7b-b407-1eb3c87f3e82 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:18:11.057607 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:11.189492 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-779f4e48-0fc3-4e29-9b16-c9bcf8b88a72 tempest-TestMinimumBasicScenario-2112472404 tempest-TestMinimumBasicScenario-2112472404-project-member] Lock "92063d97-0979-4e77-bba2-fbdd8a98d30d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.042s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:11.191991 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:11.205220 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003640510003606323 future=<Future at 0x7d7aa43aa3f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:11.206020 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772676.2047396, 0c35467a-0043-41cb-9f25-2d7f4eff3605 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:11.206221 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:11.206493 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] VM Stopped (Lifecycle Event)
May 26 05:18:11.207171 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.778981859999931 future=<Future at 0x7d7aa437a990 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:11.207278 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.778850484000031 future=<Future at 0x7d7aa437a990 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:11.298128 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:11.298461 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:11.516182 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Secret XML: <secret ephemeral="no" private="no">
May 26 05:18:11.516182 np0000001388 nova-compute[98319]:   <usage type="volume">
May 26 05:18:11.516182 np0000001388 nova-compute[98319]:     <volume>97347d8a-d57e-4631-bdc4-4b1f7aaf2a35</volume>
May 26 05:18:11.516182 np0000001388 nova-compute[98319]:   </usage>
May 26 05:18:11.516182 np0000001388 nova-compute[98319]: </secret>
May 26 05:18:11.516182 np0000001388 nova-compute[98319]:  {{(pid=98319) create_secret /opt/stack/nova/nova/virt/libvirt/host.py:1208}}
May 26 05:18:11.521641 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:11.694587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c8c36cf1-1d5a-4db1-94d5-b53992014114 req-5082560c-19f7-4fe2-a67f-ca5ce25d7f45 service nova] Releasing lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:11.695279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquired lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:11.695445 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:18:11.708957 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 0c35467a-0043-41cb-9f25-2d7f4eff3605] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:11.803637 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:12.025135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to attach volume 97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:18:12.026548 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <alias name="ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35"/>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <serial>97347d8a-d57e-4631-bdc4-4b1f7aaf2a35</serial>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="0480857a-a437-4938-8887-3832ad5e3ce1"/>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]: </disk>
May 26 05:18:12.026548 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:18:12.254606 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:12.310350 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.196s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:12.310700 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:18:12.401735 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:12.524807 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating instance_info_cache with network_info: [{"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:12.811787 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:12.814536 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:18:12.814687 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:18:12.814931 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:12.815122 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:12.878434 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:18:13.027254 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Releasing lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:13.027605 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance network_info: |[{"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:18:13.142632 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:18:13.143630 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:18:13.143852 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Creating image(s)
May 26 05:18:13.144204 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:18:13.144352 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Ensure instance console log exists: /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:18:13.144565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:13.144763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:13.144877 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:13.145394 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Start _get_guest_xml network_info=[{"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '00133517-0eaf-4e7b-b407-1eb3c87f3e82', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '17158763-773e-42db-aaf8-0a57badcf9c4', 'attached_at': '', 'detached_at': '', 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'serial': '19045b9f-cbc7-403b-84c0-d700e4df2b6c'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:18:13.149034 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:18:13.150252 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1091776158', uuid='17158763-773e-42db-aaf8-0a57badcf9c4'), owner=OwnerMeta(userid='5818c10abb5d4f01b76e07eabdde16c1', username='tempest-TestVolumeBootPatternV346-1982355268-project-member', projectid='a6588fb6c3894fadbc7f9ded9103be11', projectname='tempest-TestVolumeBootPatternV346-1982355268'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772693.1498766) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:18:13.152129 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:18:13.152477 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:18:13.153926 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:18:13.154116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:18:13.155105 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:18:13.155670 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:18:13.155816 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:18:13.155934 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:18:13.156040 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:18:13.156120 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:18:13.156254 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:18:13.156412 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:18:13.156527 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:18:13.156659 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:18:13.156768 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:18:13.156894 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:18:13.166439 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:18:13.166693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:13.166885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:13.167474 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:13.167646 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:18:13.181188 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:13.181710 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:13.182610 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:13.183258 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:13.184419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:13.184579 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:13.198536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:13.198536 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:13.199312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:13.199312 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:13.214168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c] added
May 26 05:18:13.214168 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:13.214168 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:13.214168 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:13.214168 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:13.214168 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:13.214168 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:13.214402 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:13.214552 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0326(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:13.214694 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:13.217045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c] added
May 26 05:18:13.217045 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:13.217045 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:13.217045 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:13.217045 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:13.217045 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:13.217045 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:13.217317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:13.217471 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:13.217646 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:13.321192 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:18:13.414629 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Successfully created port: 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:18:13.513704 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:13.828411 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:18:13.911962 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Successfully updated port: 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:18:13.983726 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-changed-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:13.984097 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Refreshing instance network info cache due to event network-changed-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:13.984276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] Acquiring lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:13.984372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] Acquired lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:13.984484 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Refreshing network info cache for port 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:14.215249 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:14.218475 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:14.228137 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:14.228137 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:14.233763 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:14.233763 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.240076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.248775 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.254067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.254067 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.254067 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.254067 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.254067 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:14.254321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.254321 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.254321 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.254321 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.254321 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:14.262638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.262638 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.262638 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.262638 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.262638 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:14.262825 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.262825 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.262825 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.262825 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.262825 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:14.290009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.40.100,3260]
May 26 05:18:14.290009 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.40.100,3260] successful.
May 26 05:18:14.290009 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.299404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.307026 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.50.100,3260]
May 26 05:18:14.307026 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.50.100,3260] successful.
May 26 05:18:14.307026 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.315127 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.315860 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.134s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:14.315860 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:14.316330 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('9', '-', '-', 0) found on session 201 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:14.316429 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:14.322192 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:14.334297 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Booting with volume e257c900-b4f3-402d-b268-66eebf81eb7a at /dev/vda
May 26 05:18:14.334297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 201 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:14.334297 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.338940 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:14.339092 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:14.339519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.155s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:14.339644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:14.340426 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('10', '-', '-', 0) found on session 202 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:14.340530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:14.353850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 202 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:14.353850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:14.372674 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:14.385538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:18:14.410780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:14.432290 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:14.467391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:18:14.467693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:18:14.478537 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:18:14.479439 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca'] 
May 26 05:18:14.479592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:18:14.479716 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:18:14.479970 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:14.480164 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating existing volume attachment record: 4af6ad4a-899d-467d-9fc7-ede19e60d770 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:18:14.488792 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:14.503699 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:14.565874 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:14.658372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:14.658503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:14.658613 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:14.658703 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:14.658808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:22:82:4b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:14.707524 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:15.184489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:18:15.209509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ed988c6b-5f91-4cce-94f1-3a69635bca0d req-c55b7940-189d-4def-b497-edb2e62bb656 service nova] Releasing lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:15.210050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:15.210338 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:18:15.229692 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:15.775556 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:15.913171 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:16.033958 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating instance_info_cache with network_info: [{"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:16.198976 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Found WWN 330000000a3417375 for multipath device dm-1 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:18:16.199398 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:16.199595 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '330000000a3417375', 'path': '/dev/dm-1', 'multipath_id': '330000000a3417375'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:16.199726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a3417375', 'path': '/dev/dm-1', 'multipath_id': '330000000a3417375'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:18:16.207276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-25b6ea85-1348-45de-a1e6-b74770cbead7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.407s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:16.535674 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:16.536298 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance network_info: |[{"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:18:16.583010 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:18:16.584281 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:18:16.584531 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Creating image(s)
May 26 05:18:16.584877 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:18:16.585066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Ensure instance console log exists: /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:18:16.585339 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:16.585520 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:16.585675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:16.586176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Start _get_guest_xml network_info=[{"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': '4af6ad4a-899d-467d-9fc7-ede19e60d770', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '5062f735-b5eb-4554-91d6-a1fcff9fc5ec', 'attached_at': '', 'detached_at': '', 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'serial': 'e257c900-b4f3-402d-b268-66eebf81eb7a'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:18:16.588620 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:18:16.589741 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-volume-backed-server-943151440', uuid='5062f735-b5eb-4554-91d6-a1fcff9fc5ec'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772696.5894153) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:18:16.590933 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:18:16.591263 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:18:16.592035 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:18:16.592209 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:18:16.593055 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:18:16.593316 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:18:16.593450 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:18:16.593533 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:18:16.593644 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:18:16.593721 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:18:16.593818 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:18:16.593960 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:18:16.594074 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:18:16.594155 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:18:16.594295 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:18:16.594408 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:18:16.603277 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:18:16.603581 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:16.603730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:16.604288 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:16.604489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:18:16.617007 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:16.617826 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:16.618577 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:16.618875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:16.619120 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:16.619358 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:16.632351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:16.632351 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:16.636689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:16.636689 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:16.646666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a] added
May 26 05:18:16.646666 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:16.646666 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:16.646666 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:16.646666 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:16.646666 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:16.646666 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:16.646971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:16.647073 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:16.647269 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:16.649509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a] added
May 26 05:18:16.649509 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:16.649509 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:16.649509 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:16.649509 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:16.649509 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:16.649509 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:16.649733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:16.649872 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:16.650036 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:16.705786 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1091776158',display_name='tempest-TestVolumeBootPatternV346-server-1091776158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1091776158',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAG8lb9SI5ePlJMP32xJT5ChfG+R7aTxC1y9/hg/2ujiM+Dwf9qegGeLJ3hi9WbN+wCYvh8m7Ff+XxQ4yzRc2h93zGzUXrEULESYI2SiPcw02SNb64+jXZ9RY8w+VmaHkw==',key_name='tempest-keypair-102563367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-ui85ovj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=17158763-773e-42db-aaf8-0a57badcf9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:18:16.706116 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:16.706832 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:16.707961 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'pci_devices' on Instance uuid 17158763-773e-42db-aaf8-0a57badcf9c4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:16.783416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:16.783704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:17.210929 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] End _get_guest_xml xml=<domain type="qemu">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <uuid>17158763-773e-42db-aaf8-0a57badcf9c4</uuid>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <name>instance-00000047</name>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1091776158</nova:name>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:18:13</nova:creationTime>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:user uuid="5818c10abb5d4f01b76e07eabdde16c1">tempest-TestVolumeBootPatternV346-1982355268-project-member</nova:user>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:project uuid="a6588fb6c3894fadbc7f9ded9103be11">tempest-TestVolumeBootPatternV346-1982355268</nova:project>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         <nova:port uuid="d82473f7-9a25-41d3-8c57-8ecad78453dd">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <system>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="serial">17158763-773e-42db-aaf8-0a57badcf9c4</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="uuid">17158763-773e-42db-aaf8-0a57badcf9c4</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </system>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <os>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </os>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <features>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </features>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   <devices>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/disk.config"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <alias name="ua-19045b9f-cbc7-403b-84c0-d700e4df2b6c"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-1"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <serial>19045b9f-cbc7-403b-84c0-d700e4df2b6c</serial>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:c1:30:09"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <target dev="tapd82473f7-9a"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </interface>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/console.log" append="off"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </serial>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <video>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </video>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </rng>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:   </devices>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]: </domain>
May 26 05:18:17.210929 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Preparing to wait for external event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1091776158',display_name='tempest-TestVolumeBootPatternV346-server-1091776158',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1091776158',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAG8lb9SI5ePlJMP32xJT5ChfG+R7aTxC1y9/hg/2ujiM+Dwf9qegGeLJ3hi9WbN+wCYvh8m7Ff+XxQ4yzRc2h93zGzUXrEULESYI2SiPcw02SNb64+jXZ9RY8w+VmaHkw==',key_name='tempest-keypair-102563367',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-ui85ovj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=17158763-773e-42db-aaf8-0a57badcf9c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:18:17.212853 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:17.213133 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:17.213247 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:18:17.213537 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.213738 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:17.213987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:18:17.214599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.214772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68701ff1-8e11-5b58-a98c-16ccdded23f9', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:17.215462 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.216103 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:17.217171 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.219094 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.219260 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd82473f7-9a, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:17.219609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd82473f7-9a, col_values=(('qos', UUID('338977d7-fd76-4288-a729-550a00629c9c')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:17.219810 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd82473f7-9a, col_values=(('external_ids', {'iface-id': 'd82473f7-9a25-41d3-8c57-8ecad78453dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:30:09', 'vm-uuid': '17158763-773e-42db-aaf8-0a57badcf9c4'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:17.220531 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.221530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:17.226337 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:17.227451 np0000001388 nova-compute[98319]: INFO os_vif [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a')
May 26 05:18:17.288542 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:17.647638 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:17.650472 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:17.661387 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:17.661387 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:17.667446 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:17.667446 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.674139 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.681995 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.689112 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.689266 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.696994 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.697168 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:17.730090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.40.100,3260]
May 26 05:18:17.730090 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.40.100,3260] successful.
May 26 05:18:17.730090 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.743387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.757090 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.50.100,3260]
May 26 05:18:17.757090 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.50.100,3260] successful.
May 26 05:18:17.757090 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.762286 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.762524 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:17.762677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:17.762733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:17.763574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('13', '-', '-', 0) found on session 203 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:17.763675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:17.769353 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:17.779712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 203 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:17.779790 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.787664 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:17.787898 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:17.788306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.170s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:17.788562 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:17.789831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('14', '-', '-', 0) found on session 204 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:17.789982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:17.804263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 204 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:17.804263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:17.813903 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:18.296045 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.512s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:18.521210 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:18.619595 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:18:18.747329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:18.747676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:18.747676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No VIF found with MAC fa:16:3e:c1:30:09, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:18.747848 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Using config drive
May 26 05:18:18.986545 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00036327499992694356 future=<Future at 0x7d7aa437a990 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:18.987084 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Emitting event <LifecycleEvent: 1779772683.9860663, 92063d97-0979-4e77-bba2-fbdd8a98d30d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:18.987265 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:18:18.987409 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] VM Stopped (Lifecycle Event)
May 26 05:18:19.252579 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:19.354886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:19.354886 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:19.355080 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attaching volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 to /dev/vdd
May 26 05:18:19.381294 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Creating config drive at /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/disk.config
May 26 05:18:19.385076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphrh80vkc {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:19.400228 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:19.413215 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:18:19.434315 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:19.445368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphrh80vkc" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:19.479976 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:18:19.480269 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:18:19.490121 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 92063d97-0979-4e77-bba2-fbdd8a98d30d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:19.491923 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:18:19.492941 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca'] 
May 26 05:18:19.493080 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:18:19.493181 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:18:19.493503 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:19.493711 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating existing volume attachment record: e0cee859-3229-47cf-b9f1-203974012479 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:18:19.639519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 3300000003b1eb7b8 for multipath device dm-5 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:18:19.640082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.036s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:19.640244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3036ms) {'type': 'block', 'scsi_wwn': '3300000003b1eb7b8', 'path': '/dev/dm-5', 'multipath_id': '3300000003b1eb7b8'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:19.640420 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003b1eb7b8', 'path': '/dev/dm-5', 'multipath_id': '3300000003b1eb7b8'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:18:19.870785 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:19.892086 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:19.893830 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:19.986161 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.040745 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2020f97e-6320-4d88-aed3-ed610874e67a req-c80c7d4a-2c78-4dae-bb5e-78bbc1bd2d70 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:20.041141 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2020f97e-6320-4d88-aed3-ed610874e67a req-c80c7d4a-2c78-4dae-bb5e-78bbc1bd2d70 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:20.041411 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2020f97e-6320-4d88-aed3-ed610874e67a req-c80c7d4a-2c78-4dae-bb5e-78bbc1bd2d70 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:20.041530 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2020f97e-6320-4d88-aed3-ed610874e67a req-c80c7d4a-2c78-4dae-bb5e-78bbc1bd2d70 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:20.041686 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2020f97e-6320-4d88-aed3-ed610874e67a req-c80c7d4a-2c78-4dae-bb5e-78bbc1bd2d70 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Processing event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:18:20.049244 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:18:20.049622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:18:20.049770 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:20.050158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:20.050417 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:18:20.062371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:20.063029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:18:20.063918 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:20.064114 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:20.064513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:18:20.064736 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:20.080528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:20.080528 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:20.086669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:18:20.086669 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:20.095015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22] added
May 26 05:18:20.095015 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:20.095015 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:20.095015 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:20.095015 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:20.095015 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:20.095015 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:20.095366 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:20.095366 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0312(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:20.096244 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22] added
May 26 05:18:20.100573 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:18:20.100573 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:20.100573 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:18:20.101730 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0361(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:18:20.101730 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:18:20.146529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-943151440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-943151440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-volume-backed-server-943151440',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG+49iS9bdx8yMECr9wOSpBbnt8fhdac5xzxxKslBis2wQr7ITpJ6Ln7Ur6IICKrgkffYWTOIqImOQnkr8eRp+zJhLqNt75ZnbF2zaEeqcc3Y7RsMX4p+NpKn8ELxPbJg==',key_name='tempest-keypair-28875415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zbajxr7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=5062f735-b5eb-4554-91d6-a1fcff9fc5ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:18:20.146723 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:20.147495 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:20.148349 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 5062f735-b5eb-4554-91d6-a1fcff9fc5ec {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:20.252567 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.254222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.254888 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.271351 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.572381 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772700.5719156, 17158763-773e-42db-aaf8-0a57badcf9c4 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:20.573035 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:18:20.573374 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] VM Started (Lifecycle Event)
May 26 05:18:20.577213 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:18:20.580210 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance spawned successfully.
May 26 05:18:20.580711 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:18:20.651710 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] End _get_guest_xml xml=<domain type="qemu">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <uuid>5062f735-b5eb-4554-91d6-a1fcff9fc5ec</uuid>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <name>instance-00000048</name>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-943151440</nova:name>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:18:16</nova:creationTime>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         <nova:port uuid="206affcc-e4b4-4508-acc1-2a6a3aa3eb5f">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.9" ipVersion="4"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <system>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="serial">5062f735-b5eb-4554-91d6-a1fcff9fc5ec</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="uuid">5062f735-b5eb-4554-91d6-a1fcff9fc5ec</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </system>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <os>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </os>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <features>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </features>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   <devices>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/disk.config"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <alias name="ua-e257c900-b4f3-402d-b268-66eebf81eb7a"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-5"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <serial>e257c900-b4f3-402d-b268-66eebf81eb7a</serial>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:fc:92:40"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <target dev="tap206affcc-e4"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </interface>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/console.log" append="off"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </serial>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <video>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </video>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </rng>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:   </devices>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]: </domain>
May 26 05:18:20.651710 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:18:20.653344 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Preparing to wait for external event network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:18:20.653344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:20.653344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:20.653344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:20.653344 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-943151440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-943151440',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-volume-backed-server-943151440',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG+49iS9bdx8yMECr9wOSpBbnt8fhdac5xzxxKslBis2wQr7ITpJ6Ln7Ur6IICKrgkffYWTOIqImOQnkr8eRp+zJhLqNt75ZnbF2zaEeqcc3Y7RsMX4p+NpKn8ELxPbJg==',key_name='tempest-keypair-28875415',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zbajxr7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=5062f735-b5eb-4554-91d6-a1fcff9fc5ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:18:20.653530 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:20.654011 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:20.654316 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:18:20.654916 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.655157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:20.655412 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:18:20.656062 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.656146 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99378190-13f4-5fa4-9476-0cff90dc5463', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:20.656889 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.657837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:20.658364 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.660008 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.661116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap206affcc-e4, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:20.661116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap206affcc-e4, col_values=(('qos', UUID('e170b59a-389d-409d-b565-68c76b89d4af')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:20.661116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap206affcc-e4, col_values=(('external_ids', {'iface-id': '206affcc-e4b4-4508-acc1-2a6a3aa3eb5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:92:40', 'vm-uuid': '5062f735-b5eb-4554-91d6-a1fcff9fc5ec'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:20.662089 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.663969 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:20.668285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:20.669541 np0000001388 nova-compute[98319]: INFO os_vif [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4')
May 26 05:18:21.007441 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:21.076710 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:21.078963 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:21.086943 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.087063 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.087322 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.087539 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.087799 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.088042 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:21.096014 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:18:21.101472 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:21.115639 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:21.115639 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:18:21.122729 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:18:21.122729 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.131106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.138425 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.150971 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.151248 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.159746 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.160029 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:21.195075 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.40.100,3260]
May 26 05:18:21.195075 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.40.100,3260] successful.
May 26 05:18:21.195075 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.202170 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.50.100,3260]
May 26 05:18:21.202170 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.50.100,3260] successful.
May 26 05:18:21.202170 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.209034 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.216490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.229162 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.229677 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:21.229677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.166s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:21.230097 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:21.231352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('15', '-', '-', 0) found on session 205 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:21.231510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.237433 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:18:21.237952 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.173s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:21.237952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:18:21.238934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('16', '-', '-', 0) found on session 206 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:18:21.239030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:18:21.251436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 205 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:21.251436 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:21.257420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 206 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:18:21.257420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:18:21.582225 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:18:21.582225 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772701.5811908, 17158763-773e-42db-aaf8-0a57badcf9c4 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:21.582225 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] VM Paused (Lifecycle Event)
May 26 05:18:21.592636 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Took 8.45 seconds to spawn the instance on the hypervisor.
May 26 05:18:21.592933 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:22.064633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:18:22.083881 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:22.086176 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772702.0859478, 17158763-773e-42db-aaf8-0a57badcf9c4 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:22.086335 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] VM Resumed (Lifecycle Event)
May 26 05:18:22.104431 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:22.104864 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:22.107165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:22.107686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:22.107840 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:18:22.107963 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-3e12909a-9f7a-4111-8520-e65b8a7c2ad6 req-10c5d742-54f0-42a2-a938-ab1188267153 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received unexpected event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with vm_state active and task_state None.
May 26 05:18:22.108727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Took 15.49 seconds to build instance.
May 26 05:18:22.187766 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:22.187879 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:22.187971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:fc:92:40, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:22.188257 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Using config drive
May 26 05:18:22.588412 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:22.591339 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:22.610112 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-43de95d5-856c-4ab7-a628-7df765301abc tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.995s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:22.693504 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:22.833143 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Creating config drive at /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/disk.config
May 26 05:18:22.833519 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:22.838544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpakajr2hr {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:22.897060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpakajr2hr" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:23.084769 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found WWN 3300000003389bd1e for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:18:23.085282 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:18:23.085475 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '3300000003389bd1e', 'path': '/dev/dm-8', 'multipath_id': '3300000003389bd1e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:18:23.085615 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003389bd1e', 'path': '/dev/dm-8', 'multipath_id': '3300000003389bd1e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:18:23.092715 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:23.320597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.342557 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.345159 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.440243 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.596758 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to attach volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:18:23.598248 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]: </disk>
May 26 05:18:23.598248 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:18:23.630180 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.671109 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.674372 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.679710 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:23.700056 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:24.078189 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772704.0778112, 5062f735-b5eb-4554-91d6-a1fcff9fc5ec => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:24.078361 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] VM Started (Lifecycle Event)
May 26 05:18:24.182631 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-changed-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:24.183355 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Refreshing instance network info cache due to event network-changed-d82473f7-9a25-41d3-8c57-8ecad78453dd. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:24.183571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] Acquiring lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:24.183571 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] Acquired lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:24.183681 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Refreshing network info cache for port d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:24.582026 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:24.587239 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772704.58477, 5062f735-b5eb-4554-91d6-a1fcff9fc5ec => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:24.587239 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] VM Paused (Lifecycle Event)
May 26 05:18:24.686618 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:25.006909 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:25.087996 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:25.091476 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:25.128645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updated VIF entry in instance network info cache for port d82473f7-9a25-41d3-8c57-8ecad78453dd. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:25.128919 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating instance_info_cache with network_info: [{"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:25.255824 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:25.256284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:25.256284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:25.256284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdd, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:25.256284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:25.256284 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:22:82:4b, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:25.593702 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:18:25.631221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-dc2501b8-d680-4066-9c49-bf99347e9f3f req-54c6007f-2a2a-4372-a198-f58f03e95c06 service nova] Releasing lock "refresh_cache-17158763-773e-42db-aaf8-0a57badcf9c4" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:25.661760 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:25.739518 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:26.815013 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-1f62491a-9357-4bbb-a03c-559a31b8c352 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.459s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:27.715520 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e8d0d307-880f-432c-a696-4efc16fcb349 req-66cfaf86-d06f-4d07-ac33-672e13c7f3db service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:27.716308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8d0d307-880f-432c-a696-4efc16fcb349 req-66cfaf86-d06f-4d07-ac33-672e13c7f3db service nova] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:27.716308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8d0d307-880f-432c-a696-4efc16fcb349 req-66cfaf86-d06f-4d07-ac33-672e13c7f3db service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:27.716407 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e8d0d307-880f-432c-a696-4efc16fcb349 req-66cfaf86-d06f-4d07-ac33-672e13c7f3db service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:27.716528 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e8d0d307-880f-432c-a696-4efc16fcb349 req-66cfaf86-d06f-4d07-ac33-672e13c7f3db service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Processing event network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:18:27.716982 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance event wait completed in 3 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:18:27.720212 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772707.719835, 5062f735-b5eb-4554-91d6-a1fcff9fc5ec => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:27.720420 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] VM Resumed (Lifecycle Event)
May 26 05:18:27.721497 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:18:27.725181 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance spawned successfully.
May 26 05:18:27.725487 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:18:27.835163 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:28.225665 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:28.230752 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:28.234616 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.236168 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.236845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.238795 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.239260 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.240742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:28.733649 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:18:28.751696 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Took 12.17 seconds to spawn the instance on the hypervisor.
May 26 05:18:28.751840 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:29.268781 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Took 19.67 seconds to build instance.
May 26 05:18:29.582851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:29.584391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:29.773554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2c589d01-6111-4883-b445-5b53e4663d8d tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.176s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:29.821825 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:29.822020 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:29.822176 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:29.822298 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:29.822415 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] No waiting events found dispatching network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:18:29.822531 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-21ca6fea-48dd-41d9-8559-5474eac3ea58 req-52cc4b55-f3bf-41e5-a45f-fbfea0461c29 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received unexpected event network-vif-plugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f for instance with vm_state active and task_state None.
May 26 05:18:30.085671 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:18:30.328135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:30.328558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:30.645100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:30.645404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:30.648313 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:18:30.648515 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Claim successful on node np0000001388
May 26 05:18:30.664160 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:30.830003 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:18:31.378004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:31.882295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-changed-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:31.882628 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Refreshing instance network info cache due to event network-changed-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:31.882780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] Acquiring lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:31.882897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] Acquired lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:31.882990 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Refreshing network info cache for port 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:31.943591 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:31.943845 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:32.387336 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:32.446380 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:32.675827 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:32.812227 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updated VIF entry in instance network info cache for port 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:32.812503 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating instance_info_cache with network_info: [{"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:32.836887 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:32.954699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.309s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:32.955656 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.577s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:32.955890 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:18:32.962456 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:18:32.962788 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Claim successful on node np0000001388
May 26 05:18:33.314477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0a0c0845-8a75-40b3-a7d9-181ac5cf9b8c req-6d8378fc-8833-404a-afbe-604be2298243 service nova] Releasing lock "refresh_cache-5062f735-b5eb-4554-91d6-a1fcff9fc5ec" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:33.462748 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:18:33.463169 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:18:33.463169 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:33.463440 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:33.535136 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3ee150517d34539b56afa2c9433e087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56542810ab5d4dd9b443231e8931b871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:18:33.966173 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:18:34.030870 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Successfully created port: e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:18:34.281676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:34.282049 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:34.469283 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:18:34.532226 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Successfully updated port: e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:18:34.574442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-changed-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:34.574605 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Refreshing instance network info cache due to event network-changed-e0ffb1d4-04af-4b7e-80bf-195780eab9b8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:34.574836 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] Acquiring lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:34.574918 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] Acquired lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:34.575783 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Refreshing network info cache for port e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:34.617881 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:34.618330 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:34.784658 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:35.036570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:35.078728 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:35.155210 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:35.290780 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.336s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:35.292048 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:18:35.309503 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:35.476374 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:18:35.477351 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:18:35.477571 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Creating image(s)
May 26 05:18:35.477979 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:35.478121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:35.478696 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:35.479794 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:35.482460 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:35.483399 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:35.570335 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:35.570805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:35.571391 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:35.571958 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:35.575140 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:35.575592 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:35.618879 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:35.619467 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:35.665702 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:35.666848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.091s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:35.668187 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:35.728584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:35.729225 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:35.729580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:35.799902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:18:35.800367 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:18:35.800850 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:35.801104 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:35.811496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-961dd990-58e4-4931-b93c-f23235e21453 req-927ee18f-388d-4ac6-a8d4-02dc7d5d8e2f service nova] Releasing lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:35.812267 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquired lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:35.812471 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:18:35.826930 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.097s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:35.829527 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:18:35.829740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:35.893523 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6b4b1a0cda91478583b3851a87c2d4e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da91b73f7ccf4fb3b02ddd9898a2c50e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:18:35.940726 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json" returned: 0 in 0.111s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:35.941219 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Cannot resize image /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:18:35.941584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:18:35.941765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Ensure instance console log exists: /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:18:35.942073 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:35.942332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:35.942478 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:36.304634 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:18:36.361304 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Successfully created port: f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:18:36.386333 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:36.502436 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:36.504258 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:36.563611 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:36.618306 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:36.618306 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:36.618728 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:36.618728 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:18:36.619016 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:36.703563 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating instance_info_cache with network_info: [{"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:36.808528 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:18:36.838645 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Successfully updated port: f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:18:36.922612 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-changed-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:36.922612 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Refreshing instance network info cache due to event network-changed-f7259f6e-344d-4a2f-9fb6-e873d9988f23. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:36.922792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] Acquiring lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:36.922990 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] Acquired lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:36.923425 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Refreshing network info cache for port f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:37.205451 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Releasing lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:37.205750 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance network_info: |[{"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:18:37.208148 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Start _get_guest_xml network_info=[{"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:18:37.212541 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:18:37.214117 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-1382670800', uuid='26e37518-d43d-4b89-b932-444fbafdd638'), owner=OwnerMeta(userid='a3ee150517d34539b56afa2c9433e087', username='tempest-VolumeMultiattachTests-2100574999-project-member', projectid='56542810ab5d4dd9b443231e8931b871', projectname='tempest-VolumeMultiattachTests-2100574999'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772717.213659) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:18:37.215468 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:18:37.215938 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:18:37.217025 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:18:37.217186 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:18:37.218313 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:18:37.218802 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:18:37.219971 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:18:37.219971 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:18:37.219971 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:18:37.219971 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:18:37.219971 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:18:37.220185 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:18:37.220356 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:18:37.220541 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:18:37.220744 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:18:37.221026 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:18:37.236146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1382670800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-1382670800',id=73,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-yr1385fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=26e37518-d43d-4b89-b932-444fbafdd638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:18:37.236506 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:37.237320 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:37.237954 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'pci_devices' on Instance uuid 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:37.340549 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:37.425288 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:37.489668 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:37.638978 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:37.740637 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] End _get_guest_xml xml=<domain type="qemu">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <uuid>26e37518-d43d-4b89-b932-444fbafdd638</uuid>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <name>instance-00000049</name>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-1382670800</nova:name>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:18:37</nova:creationTime>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:user uuid="a3ee150517d34539b56afa2c9433e087">tempest-VolumeMultiattachTests-2100574999-project-member</nova:user>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:project uuid="56542810ab5d4dd9b443231e8931b871">tempest-VolumeMultiattachTests-2100574999</nova:project>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         <nova:port uuid="e0ffb1d4-04af-4b7e-80bf-195780eab9b8">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <system>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="serial">26e37518-d43d-4b89-b932-444fbafdd638</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="uuid">26e37518-d43d-4b89-b932-444fbafdd638</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </system>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <os>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </os>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <features>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </features>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   <devices>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.config"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:a3:12:8f"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <target dev="tape0ffb1d4-04"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </interface>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/console.log" append="off"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </serial>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <video>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </video>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </rng>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:   </devices>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]: </domain>
May 26 05:18:37.740637 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Preparing to wait for external event network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1382670800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-1382670800',id=73,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-yr1385fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=26e37518-d43d-4b89-b932-444fbafdd638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:18:37.742916 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:37.743285 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:37.743586 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:18:37.744100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.744742 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:37.745145 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:18:37.745825 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.746115 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a02bf03-225b-5a1c-a5ba-7f2fa6148f6f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:37.747619 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:37.748261 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.751096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.751312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape0ffb1d4-04, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:37.751675 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape0ffb1d4-04, col_values=(('qos', UUID('fd9940a4-610b-472d-9c61-295210a165af')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:37.751883 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape0ffb1d4-04, col_values=(('external_ids', {'iface-id': 'e0ffb1d4-04af-4b7e-80bf-195780eab9b8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:12:8f', 'vm-uuid': '26e37518-d43d-4b89-b932-444fbafdd638'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:37.754154 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:37.759127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.760128 np0000001388 nova-compute[98319]: INFO os_vif [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04')
May 26 05:18:37.816712 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:18:37.817532 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:18:37.817758 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Creating image(s)
May 26 05:18:37.818121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:37.818278 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:37.818708 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:37.819138 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:37.821599 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:37.822575 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:37.839100 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:37.912130 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:37.912588 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:37.913057 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:37.913459 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:37.916167 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:18:37.916496 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:38.006862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:38.007209 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:38.061812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk 1073741824" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:38.062242 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:38.062554 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:38.143155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a8037c2f-6e4b-4da4-8ab2-7c8d21628bbf req-807744a0-a6b7-43c7-ba2f-0c220fe95193 service nova] Releasing lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:38.144108 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquired lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:38.144292 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:18:38.148865 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.086s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:38.149385 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking if we can resize image /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:18:38.149663 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:38.244420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:38.244818 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Cannot resize image /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:18:38.245245 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:18:38.245433 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Ensure instance console log exists: /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:18:38.245782 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:38.245997 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:38.246160 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:38.705580 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:18:38.872720 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:39.005428 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating instance_info_cache with network_info: [{"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:39.284851 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:39.285017 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:39.285138 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:a3:12:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:39.285628 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Using config drive
May 26 05:18:39.507730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Releasing lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:39.508022 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance network_info: |[{"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:18:39.510213 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Start _get_guest_xml network_info=[{"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:18:39.512627 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:18:39.514103 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-SnapshotDataIntegrityTests-server-414651452', uuid='faa9b6e7-20f7-4970-bc06-b3f1275c4a94'), owner=OwnerMeta(userid='6b4b1a0cda91478583b3851a87c2d4e6', username='tempest-SnapshotDataIntegrityTests-2135014341-project-member', projectid='da91b73f7ccf4fb3b02ddd9898a2c50e', projectname='tempest-SnapshotDataIntegrityTests-2135014341'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772719.5136633) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:18:39.515133 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:18:39.515601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:18:39.516571 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:18:39.516744 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:18:39.517781 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:18:39.518204 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:18:39.518393 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:18:39.518513 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:18:39.518676 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:18:39.518780 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:18:39.518893 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:18:39.519085 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:18:39.519208 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:18:39.519740 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:18:39.519876 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:18:39.520032 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:18:39.535816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-414651452',display_name='tempest-SnapshotDataIntegrityTests-server-414651452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-snapshotdataintegritytests-server-414651452',id=74,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpbtyY6mYlvk7QDxo+kEIuHITE9q3rYsroTo7LXwwksABRJMWNQyzRWkFphbOCo4xNt1nLyB/Rbw+sr3O6WalsZ48Lc3sm2gynbvRL0AM/xx+X7RLyj9pKBxtzKOjyoJA==',key_name='tempest-keypair-890579420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da91b73f7ccf4fb3b02ddd9898a2c50e',ramdisk_id='',reservation_id='r-n0yok81k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2135014341',owner_user_name='tempest-SnapshotDataIntegrityTests-2135014341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b4b1a0cda91478583b3851a87c2d4e6',uuid=faa9b6e7-20f7-4970-bc06-b3f1275c4a94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:18:39.536073 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converting VIF {"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:39.536663 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:39.537289 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'pci_devices' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:18:39.791495 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:39.909084 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Creating config drive at /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.config
May 26 05:18:39.912825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphuu9xrut {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:39.971878 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphuu9xrut" returned: 0 in 0.059s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:40.040742 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] End _get_guest_xml xml=<domain type="qemu">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <uuid>faa9b6e7-20f7-4970-bc06-b3f1275c4a94</uuid>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <name>instance-0000004a</name>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-414651452</nova:name>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:18:39</nova:creationTime>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:user uuid="6b4b1a0cda91478583b3851a87c2d4e6">tempest-SnapshotDataIntegrityTests-2135014341-project-member</nova:user>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:project uuid="da91b73f7ccf4fb3b02ddd9898a2c50e">tempest-SnapshotDataIntegrityTests-2135014341</nova:project>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         <nova:port uuid="f7259f6e-344d-4a2f-9fb6-e873d9988f23">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <system>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="serial">faa9b6e7-20f7-4970-bc06-b3f1275c4a94</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="uuid">faa9b6e7-20f7-4970-bc06-b3f1275c4a94</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </system>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <os>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </os>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <features>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </features>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   <devices>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.config"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </disk>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:22:4e:d6"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <target dev="tapf7259f6e-34"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </interface>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/console.log" append="off"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </serial>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <video>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </video>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </rng>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:   </devices>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]: </domain>
May 26 05:18:40.040742 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:18:40.042632 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Preparing to wait for external event network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:18:40.042632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:40.042632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:40.042632 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:40.042772 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:18:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-414651452',display_name='tempest-SnapshotDataIntegrityTests-server-414651452',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-snapshotdataintegritytests-server-414651452',id=74,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpbtyY6mYlvk7QDxo+kEIuHITE9q3rYsroTo7LXwwksABRJMWNQyzRWkFphbOCo4xNt1nLyB/Rbw+sr3O6WalsZ48Lc3sm2gynbvRL0AM/xx+X7RLyj9pKBxtzKOjyoJA==',key_name='tempest-keypair-890579420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da91b73f7ccf4fb3b02ddd9898a2c50e',ramdisk_id='',reservation_id='r-n0yok81k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-2135014341',owner_user_name='tempest-SnapshotDataIntegrityTests-2135014341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:18:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b4b1a0cda91478583b3851a87c2d4e6',uuid=faa9b6e7-20f7-4970-bc06-b3f1275c4a94,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:18:40.042919 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converting VIF {"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:18:40.043666 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:18:40.043938 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:18:40.044529 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.045078 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:40.045536 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:18:40.046597 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.046801 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b1e007f-fcd0-5fe6-9e8f-5c614bdbf1fd', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:40.048615 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:40.054640 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.056882 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.057108 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7259f6e-34, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:40.057490 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7259f6e-34, col_values=(('qos', UUID('5c9443ac-56c9-49a7-b0e7-2fc0cee587b6')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:40.057745 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7259f6e-34, col_values=(('external_ids', {'iface-id': 'f7259f6e-344d-4a2f-9fb6-e873d9988f23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:4e:d6', 'vm-uuid': 'faa9b6e7-20f7-4970-bc06-b3f1275c4a94'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:18:40.058839 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.060207 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:18:40.069067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.070353 np0000001388 nova-compute[98319]: INFO os_vif [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34')
May 26 05:18:40.411150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.439311 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.441842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.528285 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.598184 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f1f45fe8-1fc4-42e4-968d-347e9be4c87b req-541a74d3-1a62-4f17-b525-62ebc9320e72 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:40.598408 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1f45fe8-1fc4-42e4-968d-347e9be4c87b req-541a74d3-1a62-4f17-b525-62ebc9320e72 service nova] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:40.598570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1f45fe8-1fc4-42e4-968d-347e9be4c87b req-541a74d3-1a62-4f17-b525-62ebc9320e72 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:40.598720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f1f45fe8-1fc4-42e4-968d-347e9be4c87b req-541a74d3-1a62-4f17-b525-62ebc9320e72 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:40.598869 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f1f45fe8-1fc4-42e4-968d-347e9be4c87b req-541a74d3-1a62-4f17-b525-62ebc9320e72 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Processing event network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:18:40.605620 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.616028 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:40.618436 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:41.129942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:41.129942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:41.129942 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:41.129942 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:18:41.136012 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772721.1356225, 26e37518-d43d-4b89-b932-444fbafdd638 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:41.136492 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] VM Started (Lifecycle Event)
May 26 05:18:41.138310 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:18:41.144741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:18:41.148033 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance spawned successfully.
May 26 05:18:41.149292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:18:41.590391 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:41.590487 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:18:41.590624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No VIF found with MAC fa:16:3e:22:4e:d6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:18:41.591150 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Using config drive
May 26 05:18:41.639523 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:41.641211 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:41.654421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:41.654537 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:41.654816 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:41.655072 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:41.655342 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:41.655602 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:42.097335 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:42.143535 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:18:42.143914 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772722.1434448, 26e37518-d43d-4b89-b932-444fbafdd638 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:42.143914 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] VM Paused (Lifecycle Event)
May 26 05:18:42.159795 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Took 6.68 seconds to spawn the instance on the hypervisor.
May 26 05:18:42.160291 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:42.164740 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:18:42.170402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:42.235387 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Creating config drive at /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.config
May 26 05:18:42.240425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp65rzhcob {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:42.274428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:42.275447 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:42.300630 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp65rzhcob" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:42.369891 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:42.370294 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:18:42.370517 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:18:42.370637 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-8 (vdd) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:18:42.373232 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:42.462428 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:42.462972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:42.557941 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638/disk --force-share --output=json" returned: 0 in 0.095s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:42.647181 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:42.652038 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772722.651736, 26e37518-d43d-4b89-b932-444fbafdd638 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:42.652168 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] VM Resumed (Lifecycle Event)
May 26 05:18:42.659026 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:42.659286 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:42.659479 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:42.659623 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:42.659757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] No waiting events found dispatching network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:18:42.659890 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-999d834e-1a87-44eb-8587-2e167d1e85b0 req-5e124cf1-f210-44d8-af43-7e9b33697d83 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received unexpected event network-vif-plugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 for instance with vm_state active and task_state None.
May 26 05:18:42.691178 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Took 12.10 seconds to build instance.
May 26 05:18:42.717127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:42.741973 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:42.745632 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:42.830098 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:42.840983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:42.897124 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3d1085dd-7818-467a-bd23-6a36eb2bb071 req-0a12e6dd-9dab-411b-8321-bcb000b30453 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:42.897124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d1085dd-7818-467a-bd23-6a36eb2bb071 req-0a12e6dd-9dab-411b-8321-bcb000b30453 service nova] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:42.897124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d1085dd-7818-467a-bd23-6a36eb2bb071 req-0a12e6dd-9dab-411b-8321-bcb000b30453 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:42.897124 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3d1085dd-7818-467a-bd23-6a36eb2bb071 req-0a12e6dd-9dab-411b-8321-bcb000b30453 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:42.897124 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3d1085dd-7818-467a-bd23-6a36eb2bb071 req-0a12e6dd-9dab-411b-8321-bcb000b30453 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Processing event network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:18:42.913575 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:43.036688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.123s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:43.039060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:43.065654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:43.086480 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:43.155373 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:43.158270 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.119s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:43.160562 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:18:43.161725 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:43.164415 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:18:43.165212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:18:43.195060 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-bb6e070e-801b-464c-b0dd-fb48e491708a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.610s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:43.223544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.058s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:18:43.223807 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=13180MB free_disk=72.60865783691406GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:18:43.224018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:43.224180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:43.496873 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:18:43.501227 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:18:43.501821 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance spawned successfully.
May 26 05:18:43.502140 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:18:43.666044 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772723.6645353, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:43.666044 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] VM Started (Lifecycle Event)
May 26 05:18:43.948980 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:43.949150 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing instance network info cache due to event network-changed-896b9d6e-f7a4-431c-8618-e3d6812c77a0. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:43.949593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] Acquiring lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:43.949593 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] Acquired lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:43.949718 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Refreshing network info cache for port 896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:44.009307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.009307 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.009554 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.009936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.010347 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.010856 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:18:44.167926 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:44.171224 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 25b52548-45d5-4109-bd5b-d7851c560095 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 17158763-773e-42db-aaf8-0a57badcf9c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 5062f735-b5eb-4554-91d6-a1fcff9fc5ec actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 26e37518-d43d-4b89-b932-444fbafdd638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:18:44.280270 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1472MB phys_disk=95GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:18:43 up 50 min,  2 users,  load average: 3.18, 4.36, 4.43\n', 'num_instances': '5', 'num_vm_active': '4', 'num_task_None': '4', 'num_os_type_None': '5', 'num_proj_56542810ab5d4dd9b443231e8931b871': '2', 'io_workload': '1', 'num_proj_a6588fb6c3894fadbc7f9ded9103be11': '1', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_da91b73f7ccf4fb3b02ddd9898a2c50e': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:18:44.453214 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:44.516577 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Took 6.70 seconds to spawn the instance on the hypervisor.
May 26 05:18:44.516741 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:44.574184 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:18:44.574447 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:18:44.673815 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:18:44.674081 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772724.673881, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:44.674329 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] VM Paused (Lifecycle Event)
May 26 05:18:44.838224 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:44.958525 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:44.960050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:18:44.960279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:18:44.960445 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:44.960616 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] No waiting events found dispatching network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:18:44.960737 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-02d53aa0-d8ea-48f3-823f-762ea72e0d86 req-a6ebda1a-dcf1-4bbd-ac61-8e77e70078d9 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received unexpected event network-vif-plugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 for instance with vm_state active and task_state None.
May 26 05:18:44.977467 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updated VIF entry in instance network info cache for port 896b9d6e-f7a4-431c-8618-e3d6812c77a0. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:44.977736 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating instance_info_cache with network_info: [{"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:45.026181 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Took 13.69 seconds to build instance.
May 26 05:18:45.059766 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:45.078666 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:18:45.176697 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:45.178674 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772725.1784437, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:18:45.178801 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] VM Resumed (Lifecycle Event)
May 26 05:18:45.479791 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1abc7e85-f1af-4ada-a597-2cbe3a19a2ce req-8840d60c-0c2a-4903-a473-c0330431879d service nova] Releasing lock "refresh_cache-25b52548-45d5-4109-bd5b-d7851c560095" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:45.529135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.201s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:45.587479 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:18:45.587662 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.363s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:18:45.588006 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:45.680954 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:18:45.682699 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:18:46.002491 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-changed-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:46.002690 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Refreshing instance network info cache due to event network-changed-e0ffb1d4-04af-4b7e-80bf-195780eab9b8. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:46.002936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] Acquiring lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:46.003093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] Acquired lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:46.003278 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Refreshing network info cache for port e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:46.505435 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:46.808484 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:46.944237 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updated VIF entry in instance network info cache for port e0ffb1d4-04af-4b7e-80bf-195780eab9b8. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:46.944681 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating instance_info_cache with network_info: [{"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:47.019109 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-changed-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:18:47.019240 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Refreshing instance network info cache due to event network-changed-f7259f6e-344d-4a2f-9fb6-e873d9988f23. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:18:47.019460 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] Acquiring lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:18:47.019525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] Acquired lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:18:47.019709 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Refreshing network info cache for port f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:18:47.446650 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3953d7ee-4b78-4e80-9f36-1fe872da39b8 req-ad8424ad-f0fd-4eec-8d27-d3dc54b6f5ac service nova] Releasing lock "refresh_cache-26e37518-d43d-4b89-b932-444fbafdd638" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:47.524917 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:47.829615 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:18:47.842362 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:47.958415 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updated VIF entry in instance network info cache for port f7259f6e-344d-4a2f-9fb6-e873d9988f23. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:18:47.958629 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating instance_info_cache with network_info: [{"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:18:48.460514 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a5178060-2622-41ef-b2f4-8e1d0ba54a5b req-44099f68-ed76-4baa-944a-68a6ca41626d service nova] Releasing lock "refresh_cache-faa9b6e7-20f7-4970-bc06-b3f1275c4a94" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:18:50.061814 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:50.587543 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:18:50.587902 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 45.03 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:18:52.843133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:55.062747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:18:57.844521 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:00.064362 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:02.845757 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:03.601552 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:05.065065 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:05.193680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:05.193915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:05.695671 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:19:06.242932 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:06.243353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:06.246029 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:19:06.246145 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Claim successful on node np0000001388
May 26 05:19:07.559911 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:19:07.560327 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:19:07.849478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:08.062859 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:19:08.568442 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.325s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:08.568817 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:19:09.074313 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:19:09.074313 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:19:09.074588 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:09.074830 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:09.140824 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5818c10abb5d4f01b76e07eabdde16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6588fb6c3894fadbc7f9ded9103be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:19:09.555069 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Successfully created port: cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:19:09.577333 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:19:09.987843 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Successfully updated port: cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:19:10.033872 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-changed-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:10.034029 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Refreshing instance network info cache due to event network-changed-cf5ef042-fb19-4415-ab20-d7a7335e180c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:19:10.034211 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] Acquiring lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:10.034616 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] Acquired lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:10.034717 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Refreshing network info cache for port cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:19:10.067783 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:10.083404 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:19:10.489729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:10.536448 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:10.588346 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Booting with volume aef574e6-6b0f-46df-9c06-924812c1b4f3 at /dev/vda
May 26 05:19:10.605497 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:19:10.642189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:10.642454 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:10.645073 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:10.657081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:19:10.683859 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:10.727170 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:19:10.727701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:19:10.737055 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:19:10.738210 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fea3:128f', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93'] 
May 26 05:19:10.738371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:19:10.738415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:19:10.738638 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:10.738852 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating existing volume attachment record: c0b0d5a3-7202-4af2-a29f-9edb1c79c486 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:19:10.779759 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:11.147633 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:19:11.281884 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ee4a627f-768b-4e4a-a3b3-60e5fc32b020 req-396f5480-b507-48db-b8b9-d79de771b317 service nova] Releasing lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:11.282521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquired lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:11.282747 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:19:11.695389 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:11.695841 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:11.699944 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:19:11.700129 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Claim successful on node np0000001388
May 26 05:19:11.858783 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:19:11.988427 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:12.095243 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating instance_info_cache with network_info: [{"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:12.596966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Releasing lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:12.597265 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance network_info: |[{"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:19:12.842295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:19:12.843637 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:19:12.843919 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Creating image(s)
May 26 05:19:12.844293 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:19:12.844476 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Ensure instance console log exists: /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:19:12.844742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:12.844935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:12.845102 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:12.845696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Start _get_guest_xml network_info=[{"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'c0b0d5a3-7202-4af2-a29f-9edb1c79c486', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c111c430-52e7-4230-a277-1b251644c913', 'attached_at': '', 'detached_at': '', 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'serial': 'aef574e6-6b0f-46df-9c06-924812c1b4f3'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:19:12.848771 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:19:12.850084 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1810229422', uuid='c111c430-52e7-4230-a277-1b251644c913'), owner=OwnerMeta(userid='5818c10abb5d4f01b76e07eabdde16c1', username='tempest-TestVolumeBootPatternV346-1982355268-project-member', projectid='a6588fb6c3894fadbc7f9ded9103be11', projectname='tempest-TestVolumeBootPatternV346-1982355268'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772752.849708) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:19:12.851671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:12.852408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:19:12.852791 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:19:12.853712 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:19:12.853912 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:19:12.854972 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:19:12.855351 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:19:12.855541 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:19:12.855679 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:19:12.855854 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:19:12.856348 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:19:12.856511 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:19:12.856850 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:19:12.857191 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:19:12.857363 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:19:12.857544 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:19:12.857712 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:19:12.872455 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:19:12.872767 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:12.872887 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:12.873227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:12.873401 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:19:12.885644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:12.886084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:12.886317 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:12.886712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:12.887210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:12.887383 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:12.898838 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:12.898838 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:12.903719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:12.903719 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:12.912380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3] added
May 26 05:19:12.912380 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:12.912380 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:12.912380 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:12.912380 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:12.912380 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:12.912380 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:12.912574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:12.912768 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:12.912949 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:12.916190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3] added
May 26 05:19:12.916190 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:12.916190 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:12.916190 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:12.916190 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:12.916190 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:12.916190 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:12.916379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:12.916487 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0291(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:12.916623 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:13.025702 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:19:13.025929 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:19:13.528488 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:19:13.913536 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:13.917843 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:13.926001 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:13.926001 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:13.933397 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:13.933397 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:13.939318 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:13.946214 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.956378 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.956764 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.964731 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:13.965020 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:13.998574 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.40.100,3260]
May 26 05:19:13.998574 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.40.100,3260] successful.
May 26 05:19:13.998574 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:14.003422 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.50.100,3260]
May 26 05:19:14.003422 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.50.100,3260] successful.
May 26 05:19:14.003422 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:14.009703 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:14.016695 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.027458 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.027747 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:14.027953 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:14.028038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:14.029110 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('17', '-', '-', 0) found on session 207 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:14.029227 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.034841 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:14.035126 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:14.036484 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.341s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:14.037193 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.149s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:14.037442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:19:14.042062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:14.042062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('18', '-', '-', 0) found on session 208 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:14.042062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:14.042062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 207 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:14.042300 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:14.056780 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 208 and hctl ['18', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:14.544655 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:19:14.546451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:19:14.546600 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:19:14.546821 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:14.546998 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:14.611714 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:19:15.027261 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Successfully created port: d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:19:15.048937 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:19:15.057473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 208 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:15.057610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:15.068611 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:15.463509 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Successfully updated port: d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:19:15.521330 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-changed-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:15.521385 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Refreshing instance network info cache due to event network-changed-d2d55d57-fe44-41d7-887b-0f7d1926b721. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:19:15.521519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] Acquiring lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:15.521635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] Acquired lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:15.521748 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Refreshing network info cache for port d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:19:15.553418 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Booting with volume snapshot 3ad9cecd-dda2-49bf-9445-c505f6371944 at /dev/vda
May 26 05:19:15.906614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Found WWN 330000000f01d5964 for multipath device dm-9 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:19:15.906614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:15.906614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '330000000f01d5964', 'path': '/dev/dm-9', 'multipath_id': '330000000f01d5964'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:15.906614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f01d5964', 'path': '/dev/dm-9', 'multipath_id': '330000000f01d5964'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:19:15.966005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:16.023652 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:16.082682 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:19:16.213063 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:16.412861 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1810229422',display_name='tempest-TestVolumeBootPatternV346-server-1810229422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1810229422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIZZMMU3gI/Jws+Hmb9hfg0jkyMFf5ZsZi+bUDcDJW4Zl8Xgg1lAB4JAaPyy/gPrC1tu0sDx8f5JTu+e08aAGgQcw08cYmlDGuMuJmXYaGFU3aXEfSsf8ZweFXjJeWdYw==',key_name='tempest-keypair-27613430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-kc207koz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=c111c430-52e7-4230-a277-1b251644c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:19:16.413073 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:16.413646 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:16.414250 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'pci_devices' on Instance uuid c111c430-52e7-4230-a277-1b251644c913 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:16.714991 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5a4d8a80-b0d4-484a-9ff6-3a19e0684833 req-036dfd15-8540-4d6a-9f1b-4030b18fe0c7 service nova] Releasing lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:16.715430 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:16.715643 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:19:16.916733 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] End _get_guest_xml xml=<domain type="qemu">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <uuid>c111c430-52e7-4230-a277-1b251644c913</uuid>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <name>instance-0000004b</name>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1810229422</nova:name>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:19:12</nova:creationTime>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:user uuid="5818c10abb5d4f01b76e07eabdde16c1">tempest-TestVolumeBootPatternV346-1982355268-project-member</nova:user>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:project uuid="a6588fb6c3894fadbc7f9ded9103be11">tempest-TestVolumeBootPatternV346-1982355268</nova:project>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         <nova:port uuid="cf5ef042-fb19-4415-ab20-d7a7335e180c">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.10" ipVersion="4"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <system>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="serial">c111c430-52e7-4230-a277-1b251644c913</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="uuid">c111c430-52e7-4230-a277-1b251644c913</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </system>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <os>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </os>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <features>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </features>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   <devices>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/disk.config"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </disk>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <alias name="ua-aef574e6-6b0f-46df-9c06-924812c1b4f3"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-9"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <serial>aef574e6-6b0f-46df-9c06-924812c1b4f3</serial>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </disk>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:b6:9f:7f"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <target dev="tapcf5ef042-fb"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </interface>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/console.log" append="off"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </serial>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <video>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </video>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </rng>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:   </devices>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]: </domain>
May 26 05:19:16.916733 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:19:16.918512 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Preparing to wait for external event network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:19:16.918512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:16.918512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:16.918512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:16.918512 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1810229422',display_name='tempest-TestVolumeBootPatternV346-server-1810229422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1810229422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIZZMMU3gI/Jws+Hmb9hfg0jkyMFf5ZsZi+bUDcDJW4Zl8Xgg1lAB4JAaPyy/gPrC1tu0sDx8f5JTu+e08aAGgQcw08cYmlDGuMuJmXYaGFU3aXEfSsf8ZweFXjJeWdYw==',key_name='tempest-keypair-27613430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-kc207koz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:19:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=c111c430-52e7-4230-a277-1b251644c913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:19:16.918710 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:16.919120 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:16.919460 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:19:16.919936 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.920295 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:16.920598 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:19:16.921286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.921488 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb59a3d3-26e9-5f72-8959-c97351c0c46f', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:16.935986 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.936828 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:16.938748 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.938933 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcf5ef042-fb, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:16.939324 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcf5ef042-fb, col_values=(('qos', UUID('43403f37-aae3-4d77-a906-24c020db3b48')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:16.939540 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcf5ef042-fb, col_values=(('external_ids', {'iface-id': 'cf5ef042-fb19-4415-ab20-d7a7335e180c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:9f:7f', 'vm-uuid': 'c111c430-52e7-4230-a277-1b251644c913'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:16.940281 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.941652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:16.945877 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:16.946624 np0000001388 nova-compute[98319]: INFO os_vif [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb')
May 26 05:19:17.270026 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:19:17.399930 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:17.505937 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating instance_info_cache with network_info: [{"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:17.849872 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:18.007915 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:18.008215 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance network_info: |[{"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:19:18.461386 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:18.461739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:18.461739 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No VIF found with MAC fa:16:3e:b6:9f:7f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:19:18.462044 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Using config drive
May 26 05:19:18.935663 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:18.947451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:19:18.967957 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:18.971502 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:19.015568 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:19:19.015847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:19:19.024380 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:19:19.026776 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fea3:128f', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93'] 
May 26 05:19:19.026908 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:19:19.027016 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:19:19.027320 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:19.027702 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating existing volume attachment record: b2d71af6-e94e-4730-8d3a-449d5f5538c8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:19:19.089940 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Creating config drive at /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/disk.config
May 26 05:19:19.093210 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxi9p326i {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:19.145923 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxi9p326i" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:19.526279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:19.547871 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:19.550136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:19.636853 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:19.687278 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28fba2b3-fd90-4e0a-81e0-1727c5c6ff97 req-149f5631-ff24-45c1-b310-6c82a30f574e service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:19.687813 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28fba2b3-fd90-4e0a-81e0-1727c5c6ff97 req-149f5631-ff24-45c1-b310-6c82a30f574e service nova] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:19.688127 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28fba2b3-fd90-4e0a-81e0-1727c5c6ff97 req-149f5631-ff24-45c1-b310-6c82a30f574e service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:19.688279 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-28fba2b3-fd90-4e0a-81e0-1727c5c6ff97 req-149f5631-ff24-45c1-b310-6c82a30f574e service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:19.688465 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-28fba2b3-fd90-4e0a-81e0-1727c5c6ff97 req-149f5631-ff24-45c1-b310-6c82a30f574e service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Processing event network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:19:19.694849 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:19.695822 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:20.244864 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772760.2444983, c111c430-52e7-4230-a277-1b251644c913 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:20.245264 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:19:20.246269 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] VM Started (Lifecycle Event)
May 26 05:19:20.248917 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:19:20.250739 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance spawned successfully.
May 26 05:19:20.250888 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:19:20.748833 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:20.749140 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:20.751259 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:20.757073 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:19:20.759870 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:20.760085 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:20.760401 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:20.760596 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:20.760817 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:20.761038 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:21.124424 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:19:21.125303 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:19:21.125540 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Creating image(s)
May 26 05:19:21.125970 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:19:21.125970 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Ensure instance console log exists: /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:19:21.126180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:21.126373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:21.126491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:21.127135 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Start _get_guest_xml network_info=[{"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-26T05:19:07Z,direct_url=<?>,disk_format='raw',id=7a59af43-c603-4603-9e2d-534337efa761,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-636798824',owner='8c30ab7dc7994525ab85e2c2588023b2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-26T05:19:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': True, 'attachment_id': 'b2d71af6-e94e-4730-8d3a-449d5f5538c8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '38cb43d7-d96c-48d7-ab0a-1890f44e8956', 'attached_at': '', 'detached_at': '', 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'serial': '20802b6a-f648-434f-9976-0b59414db7fc'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:19:21.129610 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:19:21.130731 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-image-snapshot-server-292679573', uuid='38cb43d7-d96c-48d7-ab0a-1890f44e8956'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='7a59af43-c603-4603-9e2d-534337efa761', name=None, container_format='bare', disk_format='raw', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio', 'img_bdm_v2': True, 'img_root_device_name': '/dev/vda'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772761.130407) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:19:21.131719 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:19:21.132023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:19:21.132949 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:19:21.133120 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:19:21.133890 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:19:21.134209 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2026-05-26T05:19:07Z,direct_url=<?>,disk_format='raw',id=7a59af43-c603-4603-9e2d-534337efa761,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-636798824',owner='8c30ab7dc7994525ab85e2c2588023b2',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2026-05-26T05:19:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:19:21.134368 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:19:21.134455 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:19:21.134561 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:19:21.134631 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:19:21.134723 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:19:21.134853 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:19:21.134941 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:19:21.135036 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:19:21.135125 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:19:21.135285 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:19:21.145132 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:19:21.145504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:21.145673 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:21.145987 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:21.146193 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:19:21.160477 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:21.161056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:21.161306 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:21.161938 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:21.162465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:21.162641 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:21.173246 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:21.173246 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:21.182220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:21.182220 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:21.186185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc] added
May 26 05:19:21.186185 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:21.186185 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:21.186185 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:21.186185 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:21.186185 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:21.186185 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:21.186553 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:21.186553 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0252(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:21.186684 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:21.190114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc] added
May 26 05:19:21.190114 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:21.190114 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:21.190114 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:21.190114 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:21.190114 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:21.190114 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:21.190580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:21.190580 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0278(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:21.190580 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:21.253272 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:21.261153 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:19:21.261153 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772761.2600336, c111c430-52e7-4230-a277-1b251644c913 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:21.261153 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] VM Paused (Lifecycle Event)
May 26 05:19:21.265717 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Took 8.42 seconds to spawn the instance on the hypervisor.
May 26 05:19:21.265990 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:21.742116 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:21.742373 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:21.742521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:21.742636 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:21.742756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] No waiting events found dispatching network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:21.742882 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-443105b7-3853-4ce2-88e3-d2681569e587 req-34436f5e-cfd6-4c2a-92af-1d62eb7101e5 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received unexpected event network-vif-plugged-cf5ef042-fb19-4415-ab20-d7a7335e180c for instance with vm_state active and task_state None.
May 26 05:19:21.762653 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:21.764765 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772761.764528, c111c430-52e7-4230-a277-1b251644c913 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:21.764909 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] VM Resumed (Lifecycle Event)
May 26 05:19:21.779695 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Took 15.58 seconds to build instance.
May 26 05:19:21.941661 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:22.187164 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:22.192612 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:22.199142 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:22.199142 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:22.206941 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:22.206941 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.211662 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.221238 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.229512 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.230068 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.241177 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.241680 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:22.257740 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:22.267514 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:22.270229 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c111c430-52e7-4230-a277-1b251644c913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:19:22.281732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.40.100,3260]
May 26 05:19:22.281732 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.40.100,3260] successful.
May 26 05:19:22.281732 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.282397 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-d0213657-5ab8-49fc-b3b4-68a8bb5785ef tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.088s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:22.292557 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.50.100,3260]
May 26 05:19:22.292557 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.50.100,3260] successful.
May 26 05:19:22.292557 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.293588 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.305361 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.318070 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.156s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('19', '-', '-', 0) found on session 209 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:22.318070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.328389 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:22.328676 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:22.328948 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:22.329189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:22.332393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('20', '-', '-', 0) found on session 210 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:22.332393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:22.338286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 209 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:22.338286 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:22.345523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 210 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:22.345523 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:22.851935 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:23.163265 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:19:23.329004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:23.332215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:23.332215 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Attaching volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 to /dev/vdb
May 26 05:19:23.366222 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:23.376480 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:19:23.395712 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:23.438064 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:19:23.438865 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fea3:128f', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f'] 
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:23.451277 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating existing volume attachment record: 5505efd4-e216-4eb8-9ee2-d1d1907bd95b {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:19:23.525657 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:23.526065 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:23.817098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-changed-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:23.817098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Refreshing instance network info cache due to event network-changed-cf5ef042-fb19-4415-ab20-d7a7335e180c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:19:23.817098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] Acquiring lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:23.817098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] Acquired lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:23.817098 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Refreshing network info cache for port cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:19:24.010545 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:19:24.010545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:24.010545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:24.029694 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:24.177946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 3300000004dbcfcf1 for multipath device dm-12 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:19:24.178345 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.032s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:24.178522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3032ms) {'type': 'block', 'scsi_wwn': '3300000004dbcfcf1', 'path': '/dev/dm-12', 'multipath_id': '3300000004dbcfcf1'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:24.178646 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004dbcfcf1', 'path': '/dev/dm-12', 'multipath_id': '3300000004dbcfcf1'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:19:24.179721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.169s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:24.179721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:19:24.190968 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:24.191321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:24.191486 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:24.192410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:24.192986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:24.193173 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:24.202929 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:24.202929 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.startup = automatic
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.scan = manual
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:24.208781 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:24.208781 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:24.215608 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:24.221362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.236370 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.236722 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:24.236982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.045s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:24.236982 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:24.240212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('15', '0', '0', 0) found on session 205 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:24.240212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.242695 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:24.243120 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:24.243561 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.050s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:24.243561 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:24.244081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('16', '0', '0', 0) found on session 206 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:24.244180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:24.250190 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 205 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:24.250410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:24.253972 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 206 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:24.254081 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:24.322220 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:24.573219 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:24.685522 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Updated VIF entry in instance network info cache for port cf5ef042-fb19-4415-ab20-d7a7335e180c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:19:24.685522 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating instance_info_cache with network_info: [{"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:24.686693 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-image-snapshot-server-292679573',id=76,image_ref='7a59af43-c603-4603-9e2d-534337efa761',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2SX8fNLfF6WvWl/Z8BOnSFaPgzm5FxT2T7D5chztYzyiInNGNZScf8sqEAcNfTzATv/9LW/LMi/yee9xnaN/2ELglTKhB6j9iRJT8WvPDcJCQUsyyYlkbwLOgKPmCavw==',key_name='tempest-keypair-98781848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zx70zt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-877823063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=38cb43d7-d96c-48d7-ab0a-1890f44e8956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:19:24.686998 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:24.687693 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:24.688601 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 38cb43d7-d96c-48d7-ab0a-1890f44e8956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:25.034527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:25.188966 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-49d1a13f-bf7b-4356-8ef3-d06ec56b2d77 req-1cb5f822-c5f2-466e-929a-87ad44e9499b service nova] Releasing lock "refresh_cache-c111c430-52e7-4230-a277-1b251644c913" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:25.191972 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] End _get_guest_xml xml=<domain type="qemu">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <uuid>38cb43d7-d96c-48d7-ab0a-1890f44e8956</uuid>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <name>instance-0000004c</name>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-292679573</nova:name>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:19:21</nova:creationTime>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:diskFormat>raw</nova:diskFormat>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_cdrom_bus">ide</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_disk_bus">virtio</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_machine_type">pc</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_video_model">virtio</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="hw_vif_model">virtio</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="img_bdm_v2">True</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:property name="img_root_device_name">/dev/vda</nova:property>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid=""/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         <nova:port uuid="d2d55d57-fe44-41d7-887b-0f7d1926b721">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.3" ipVersion="4"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <system>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="serial">38cb43d7-d96c-48d7-ab0a-1890f44e8956</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="uuid">38cb43d7-d96c-48d7-ab0a-1890f44e8956</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </system>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <os>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </os>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <features>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </features>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   <devices>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/disk.config"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </disk>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <alias name="ua-20802b6a-f648-434f-9976-0b59414db7fc"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-12"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <serial>20802b6a-f648-434f-9976-0b59414db7fc</serial>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </disk>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:aa:68:32"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <target dev="tapd2d55d57-fe"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </interface>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/console.log" append="off"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </serial>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <video>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </video>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </rng>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:   </devices>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]: </domain>
May 26 05:19:25.191972 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:19:25.194939 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Preparing to wait for external event network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:19:25.194939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:25.194939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:25.194939 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:25.195417 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-image-snapshot-server-292679573',id=76,image_ref='7a59af43-c603-4603-9e2d-534337efa761',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2SX8fNLfF6WvWl/Z8BOnSFaPgzm5FxT2T7D5chztYzyiInNGNZScf8sqEAcNfTzATv/9LW/LMi/yee9xnaN/2ELglTKhB6j9iRJT8WvPDcJCQUsyyYlkbwLOgKPmCavw==',key_name='tempest-keypair-98781848',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zx70zt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-877823063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:19:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=38cb43d7-d96c-48d7-ab0a-1890f44e8956,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:19:25.195743 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:25.196454 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:25.196771 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:19:25.197407 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.197771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:25.198067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:19:25.199192 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.199403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34b0cbf3-00ce-526c-974d-1fb64d2cb913', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:25.200159 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.200815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:25.201279 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.201950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:19:25.203983 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.204083 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2d55d57-fe, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:25.204413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd2d55d57-fe, col_values=(('qos', UUID('f177c3e4-8f89-49e4-885b-00afb469c03e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:25.204559 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd2d55d57-fe, col_values=(('external_ids', {'iface-id': 'd2d55d57-fe44-41d7-887b-0f7d1926b721', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:68:32', 'vm-uuid': '38cb43d7-d96c-48d7-ab0a-1890f44e8956'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:25.205158 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.206122 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:25.210709 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:25.212480 np0000001388 nova-compute[98319]: INFO os_vif [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe')
May 26 05:19:26.092827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:26.093384 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:26.093384 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attaching volume 6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e to /dev/vdb
May 26 05:19:26.129373 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:26.140032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:19:26.160074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:26.201792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:19:26.202111 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:19:26.212440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:19:26.213658 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fea3:128f', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f'] 
May 26 05:19:26.213810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:19:26.213950 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:19:26.214230 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:26.214619 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating existing volume attachment record: c13933d6-9d0a-4521-9251-73326a5554c5 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:19:26.222220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found WWN 3300000003389bd1e for multipath device dm-8 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:19:26.222220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.041s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:26.222220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== connect_volume: return (2209ms) {'type': 'block', 'scsi_wwn': '3300000003389bd1e', 'path': '/dev/dm-8', 'multipath_id': '3300000003389bd1e'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:26.222220 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003389bd1e', 'path': '/dev/dm-8', 'multipath_id': '3300000003389bd1e'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:19:26.226643 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:26.732784 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Attempting to attach volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:19:26.734804 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:26.734804 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:19:26.735756 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:26.735909 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:26.736027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:aa:68:32, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:19:26.736603 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Using config drive
May 26 05:19:26.771069 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:19:26.771541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:26.771721 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:26.772211 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:26.772490 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:19:26.786014 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:26.786513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:26.787023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:26.787206 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:26.787538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:26.787926 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:26.799301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:26.799301 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:26.806130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:26.806130 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:26.813468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e] added
May 26 05:19:26.813468 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:26.813468 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:26.813468 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:26.813468 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:26.813468 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:26.813468 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:26.813670 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:26.813745 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0265(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:26.813873 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:26.817632 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e] added
May 26 05:19:26.817632 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:26.817632 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:26.817632 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:26.817632 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:26.817632 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:26.817632 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:26.817800 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:26.817889 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.03(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:26.818010 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:27.242082 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:27.353562 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Creating config drive at /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/disk.config
May 26 05:19:27.357269 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqrphx4ig {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:27.413624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqrphx4ig" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:27.778894 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.798262 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.801228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.814444 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:27.819156 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:27.828558 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:27.828558 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:27.837216 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:27.837216 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.842986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.849644 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.856431 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.869056 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.869627 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.870261 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.870536 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:27.887483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.934746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.50.100,3260]
May 26 05:19:27.934746 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.50.100,3260] successful.
May 26 05:19:27.934746 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.945567 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d5886934-2564-475f-b38f-ed24498331ee req-16051267-84f2-447c-bcc3-3cd4fecc7c00 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:27.946675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5886934-2564-475f-b38f-ed24498331ee req-16051267-84f2-447c-bcc3-3cd4fecc7c00 service nova] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:27.946675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5886934-2564-475f-b38f-ed24498331ee req-16051267-84f2-447c-bcc3-3cd4fecc7c00 service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:27.946675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d5886934-2564-475f-b38f-ed24498331ee req-16051267-84f2-447c-bcc3-3cd4fecc7c00 service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:27.946675 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d5886934-2564-475f-b38f-ed24498331ee req-16051267-84f2-447c-bcc3-3cd4fecc7c00 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Processing event network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:19:27.947946 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.951075 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.40.100,3260]
May 26 05:19:27.951075 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.40.100,3260] successful.
May 26 05:19:27.951075 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.958628 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.960966 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.973666 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:27.974393 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.974682 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:27.976876 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.189s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:27.977076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:27.979654 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('21', '-', '-', 0) found on session 211 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:27.979994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.998659 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:27.999004 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:27.999371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:27.999371 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:28.003062 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 211 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:28.003658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('22', '-', '-', 0) found on session 212 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:28.004301 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:28.004725 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:28.027615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 212 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:28.027615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:28.393006 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:28.393582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:28.393582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:28.393582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:a3:12:8f, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:19:28.532147 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772768.531782, 38cb43d7-d96c-48d7-ab0a-1890f44e8956 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:28.532574 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:19:28.532745 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] VM Started (Lifecycle Event)
May 26 05:19:28.534936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:19:28.536585 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance spawned successfully.
May 26 05:19:28.536856 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:19:28.539167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:28.539469 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:19:28.790932 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:19:29.043452 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:29.045040 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Took 7.92 seconds to spawn the instance on the hypervisor.
May 26 05:19:29.045211 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:29.047331 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:19:29.552557 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:19:29.555385 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772769.5551414, 38cb43d7-d96c-48d7-ab0a-1890f44e8956 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:29.555554 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] VM Paused (Lifecycle Event)
May 26 05:19:29.556366 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Took 17.90 seconds to build instance.
May 26 05:19:29.806974 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found WWN 330000000194a36f0 for multipath device dm-15 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:19:29.807346 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:29.807491 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000194a36f0', 'path': '/dev/dm-15', 'multipath_id': '330000000194a36f0'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:29.807564 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000194a36f0', 'path': '/dev/dm-15', 'multipath_id': '330000000194a36f0'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:19:29.810134 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:29.940996 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5678a871-ea23-4f6b-a50b-7f19ad8ae9c1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.612s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:30.001832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:30.002033 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:30.002264 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:30.002420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:30.002568 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] No waiting events found dispatching network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:30.002727 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-c15f212b-f714-4d5a-9f92-5bb8dd50db5b req-20919bcd-c14d-47f0-b0b7-f7114a6b02ff service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received unexpected event network-vif-plugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 for instance with vm_state active and task_state None.
May 26 05:19:30.058302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-e491e754-6e6d-4b4b-80f6-e3fabb812f08 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.416s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:30.059322 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:30.061154 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772770.0609376, 38cb43d7-d96c-48d7-ab0a-1890f44e8956 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:30.061369 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] VM Resumed (Lifecycle Event)
May 26 05:19:30.205946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:30.312880 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to attach volume 6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:19:30.314219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:   <alias name="ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e"/>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-15"/>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:   <serial>6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e</serial>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:30.314219 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:19:30.563626 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:30.565394 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:19:31.415321 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:31.415509 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:31.917688 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Detaching volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:19:31.963069 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Attempting to driver detach volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 from mountpoint /dev/vdb
May 26 05:19:31.966837 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:31.967035 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:31.969096 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:31.969096 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No VIF found with MAC fa:16:3e:22:4e:d6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:19:31.971529 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:31.975437 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:31.975587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Attempting to detach device vdb from instance 26e37518-d43d-4b89-b932-444fbafdd638 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:19:31.975801 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:31.975801 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:31.981086 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance 26e37518-d43d-4b89-b932-444fbafdd638 from the persistent domain config.
May 26 05:19:31.981513 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] (1/8): Attempting to detach device vdb with device alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 from instance 26e37518-d43d-4b89-b932-444fbafdd638 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:19:31.981765 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:31.981765 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:32.070079 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-changed-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:32.070266 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Refreshing instance network info cache due to event network-changed-d2d55d57-fe44-41d7-887b-0f7d1926b721. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:19:32.070817 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] Acquiring lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:19:32.070944 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] Acquired lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:19:32.071115 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Refreshing network info cache for port d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:19:32.460007 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772772.459632, 26e37518-d43d-4b89-b932-444fbafdd638 => ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:19:32.460746 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 for instance 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:19:32.463082 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance 26e37518-d43d-4b89-b932-444fbafdd638 from the live domain config.
May 26 05:19:32.573408 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:32.858577 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:32.891955 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:32.998300 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Detected multiple connections on this host for volume: 8f607cc5-8bd6-46d8-bdd1-862d26e62a22, skipping target disconnect.
May 26 05:19:33.031507 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updated VIF entry in instance network info cache for port d2d55d57-fe44-41d7-887b-0f7d1926b721. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:19:33.031653 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating instance_info_cache with network_info: [{"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:33.526943 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cf3de59c-f5a7-40af-a07b-dccb5f976d55 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.434s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:33.537438 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e095e61b-038c-4abe-92ee-710c4ccda12f req-4fbc7541-bbb4-4b03-aec8-a88c7fb373ce service nova] Releasing lock "refresh_cache-38cb43d7-d96c-48d7-ab0a-1890f44e8956" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:19:33.555504 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:34.560527 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-3f837ffa-c7ca-46ab-9a11-8f84fcbe08b9 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.145s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:34.616763 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:34.617010 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:34.617107 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:34.617272 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:34.617372 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:34.619304 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Terminating instance
May 26 05:19:35.121832 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:19:35.136216 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.138438 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.159507 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.206855 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] No waiting events found dispatching network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:35.304088 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-38f21c15-2b8d-438c-b5f5-751e39879346 req-d0b8a60f-86ac-47e7-a179-78e11edbd14a service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:19:35.330927 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.334613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.454144 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999700716000007 future=<Future at 0x7d7aa43d1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:35.454662 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999173631999838 future=<Future at 0x7d7aa43d1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:35.454769 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999033171000065 future=<Future at 0x7d7aa43d1670 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:35.454882 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Instance destroyed successfully.
May 26 05:19:35.455344 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'resources' on Instance uuid 26e37518-d43d-4b89-b932-444fbafdd638 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:35.618050 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:35.618747 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:35.957465 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-1382670800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-1382670800',id=73,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:18:42Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-yr1385fq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:18:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=26e37518-d43d-4b89-b932-444fbafdd638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:19:35.957773 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "address": "fa:16:3e:a3:12:8f", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tape0ffb1d4-04", "ovs_interfaceid": "e0ffb1d4-04af-4b7e-80bf-195780eab9b8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:35.958347 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:35.958599 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:19:35.959873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.960294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape0ffb1d4-04, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:35.961376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.962042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:35.962562 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.963425 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.963543 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd9940a4-610b-472d-9c61-295210a165af) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:35.963970 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.964381 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:35.964811 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:35.967167 np0000001388 nova-compute[98319]: INFO os_vif [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a3:12:8f,bridge_name='br-int',has_traffic_filtering=True,id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape0ffb1d4-04')
May 26 05:19:35.967167 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Deleting instance files /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638_del
May 26 05:19:35.967860 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Deletion of /opt/stack/data/nova/instances/26e37518-d43d-4b89-b932-444fbafdd638_del complete
May 26 05:19:36.473747 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:19:36.474493 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:19:36.474746 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:19:36.474982 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:19:36.475246 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:36.575783 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:36.993778 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5ef12b22-b669-4c85-ba1f-d39f8bd7ce95 req-a2bafd40-eb5d-4df1-89fc-21c1be7fd026 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-deleted-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:36.994130 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5ef12b22-b669-4c85-ba1f-d39f8bd7ce95 req-a2bafd40-eb5d-4df1-89fc-21c1be7fd026 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Neutron deleted interface e0ffb1d4-04af-4b7e-80bf-195780eab9b8; detaching it from the instance and deleting it from the info cache
May 26 05:19:36.994130 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5ef12b22-b669-4c85-ba1f-d39f8bd7ce95 req-a2bafd40-eb5d-4df1-89fc-21c1be7fd026 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:37.373672 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:37.373907 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] Acquiring lock "26e37518-d43d-4b89-b932-444fbafdd638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:37.374375 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:37.374528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] Lock "26e37518-d43d-4b89-b932-444fbafdd638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:37.374651 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] No waiting events found dispatching network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:37.374801 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-56e5b34b-4ace-48e2-b8e3-f8ab5c2ba925 req-dcfd645d-5b9d-4427-9de1-7a0ab215afc6 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Received event network-vif-unplugged-e0ffb1d4-04af-4b7e-80bf-195780eab9b8 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:19:37.450586 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:37.497558 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5ef12b22-b669-4c85-ba1f-d39f8bd7ce95 req-a2bafd40-eb5d-4df1-89fc-21c1be7fd026 service nova] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Detach interface failed, port_id=e0ffb1d4-04af-4b7e-80bf-195780eab9b8, reason: Instance 26e37518-d43d-4b89-b932-444fbafdd638 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:19:37.617615 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:37.617980 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:37.618251 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:37.618615 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:19:37.618872 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:37.857147 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:37.952380 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Took 1.48 seconds to deallocate network for instance.
May 26 05:19:38.458587 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:38.459007 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:38.501851 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:38.502429 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.11 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:38.619077 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:38.619583 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:38.808402 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:19:38.808606 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:19:39.311252 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:19:39.817400 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.358s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:39.864901 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Deleted allocations for instance 26e37518-d43d-4b89-b932-444fbafdd638
May 26 05:19:40.617842 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:40.872050 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-8ab34386-47ed-481e-8d0d-6e07644bce3a tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "26e37518-d43d-4b89-b932-444fbafdd638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.255s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:40.965012 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:41.122506 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:41.122633 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:41.122755 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:41.122885 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:19:41.723754 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:41.723945 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:41.900349 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:42.161902 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.165213 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:42.228725 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Detaching volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22
May 26 05:19:42.255720 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:42.259218 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:42.271850 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to driver detach volume 8f607cc5-8bd6-46d8-bdd1-862d26e62a22 from mountpoint /dev/vdd
May 26 05:19:42.280023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdd by alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:42.281323 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdd by alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:42.281461 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Attempting to detach device vdd from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:19:42.281901 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:42.281901 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:42.287748 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdd from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config.
May 26 05:19:42.287910 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] (1/8): Attempting to detach device vdd with device alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:19:42.288210 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <alias name="ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22"/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-8"/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <target dev="vdd" bus="virtio"/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <serial>8f607cc5-8bd6-46d8-bdd1-862d26e62a22</serial>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x09" function="0x0"/>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:42.288210 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:42.344934 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:42.345350 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.345931 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/disk/by-id/os-brick+dev+dm-0 (vdc) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.345931 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-8 (vdd) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.350214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:42.438336 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.090s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:42.442214 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:42.541377 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:42.542140 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-15 (vdb) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.545916 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-5 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.547384 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-12 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.549027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:19:42.553215 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:19:42.553215 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:42.600594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.048s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:19:42.601207 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12248MB free_disk=72.56998825073242GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:19:42.601557 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:42.601949 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:42.794884 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772782.7941856, 25b52548-45d5-4109-bd5b-d7851c560095 => ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:19:42.795455 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Start waiting for the detach event from libvirt for device vdd with device alias ua-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 for instance 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:19:42.798325 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdd from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config.
May 26 05:19:42.832697 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:19:42.833070 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:42.833228 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:42.833648 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:42.833980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:19:42.834143 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:19:42.858719 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:42.866736 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [205] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [206] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:42.867302 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', '205'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', '206'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:19:42.867302 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', '205')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:42.868504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22', '206')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:42.869450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4420cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'): ({'sdk'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:19:42.869675 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Removing multipathed devices sdk, sdj {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:19:42.869936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flush multipath device 3300000003389bd1e {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:19:42.897511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:42.943568 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:42.967117 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:42.967347 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:42.988642 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:19:42.988781 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] SCSI volumes sdk, sdj have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:19:42.990788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if device paths {'sdk', 'sdj'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:19:43.003008 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Device paths {'sdk', 'sdj'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:19:43.003219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:19:43.015370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.061458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 205, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.40.100,3260]
May 26 05:19:43.061458 np0000001388 nova-compute[98319]: Logout of [sid: 205, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.40.100,3260] successful.
May 26 05:19:43.061458 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.091465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.104292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.152278 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 206, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.50.100,3260]
May 26 05:19:43.152278 np0000001388 nova-compute[98319]: Logout of [sid: 206, target: iqn.2023-03.storpool.com:os--volume-8f607cc5-8bd6-46d8-bdd1-862d26e62a22, portal: 192.168.50.100,3260] successful.
May 26 05:19:43.152278 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.175082 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:43.175339 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:43.175463 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== disconnect_volume: return (341ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:43.175574 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:19:43.470410 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Detaching volume 6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e
May 26 05:19:43.514801 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to driver detach volume 6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e from mountpoint /dev/vdb
May 26 05:19:43.522737 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:43.524746 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:43.524867 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Attempting to detach device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:19:43.525106 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <alias name="ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e"/>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-15"/>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <serial>6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e</serial>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:43.525106 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:43.530829 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config.
May 26 05:19:43.530957 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] (1/8): Attempting to detach device vdb with device alias ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:19:43.531174 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <alias name="ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e"/>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-15"/>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <serial>6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e</serial>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:43.531174 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 25b52548-45d5-4109-bd5b-d7851c560095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 17158763-773e-42db-aaf8-0a57badcf9c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 5062f735-b5eb-4554-91d6-a1fcff9fc5ec actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c111c430-52e7-4230-a277-1b251644c913 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 38cb43d7-d96c-48d7-ab0a-1890f44e8956 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:19:43.655214 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:19:42 up 51 min,  2 users,  load average: 3.47, 4.24, 4.38\n', 'num_instances': '6', 'num_vm_active': '6', 'num_task_None': '6', 'num_os_type_None': '6', 'num_proj_56542810ab5d4dd9b443231e8931b871': '1', 'io_workload': '0', 'num_proj_a6588fb6c3894fadbc7f9ded9103be11': '2', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '2', 'num_proj_da91b73f7ccf4fb3b02ddd9898a2c50e': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:19:43.729547 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:43.937536 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:19:43.937536 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:19:44.011122 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772784.010802, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:19:44.012454 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e for instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:19:44.014785 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config.
May 26 05:19:44.015726 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:19:44.015976 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:44.016103 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:44.016403 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:44.016633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-15'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:19:44.016736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:44.048049 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [211] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: tcp: [212] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e (non-flash)
May 26 05:19:44.048452 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '211'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:19:44.048452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '212')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:44.049922 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e', '211')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:44.050896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c2ca0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'): ({'sdp'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:19:44.051067 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Removing multipathed devices sdp, sdq {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:19:44.051415 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flush multipath device 330000000194a36f0 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:19:44.088021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:44.120559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:44.167508 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:19:44.167712 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:19:44.169730 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:19:44.180655 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:19:44.180805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:19:44.192117 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.226130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 212, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.40.100,3260]
May 26 05:19:44.226130 np0000001388 nova-compute[98319]: Logout of [sid: 212, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.40.100,3260] successful.
May 26 05:19:44.226130 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.252917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.264772 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.302065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 211, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.50.100,3260]
May 26 05:19:44.302065 np0000001388 nova-compute[98319]: Logout of [sid: 211, target: iqn.2023-03.storpool.com:os--volume-6ac0d7c8-a5b1-4130-80bc-75d038fd8b9e, portal: 192.168.50.100,3260] successful.
May 26 05:19:44.302065 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.321842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:44.322065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:44.322217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== disconnect_volume: return (306ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:44.322382 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:19:44.440594 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:19:44.735076 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-081aa178-9d99-40ef-b194-7bb5d61e79ce tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.011s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:44.862919 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:44.947544 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:19:44.947711 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.346s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:44.947992 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:45.010180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:45.010346 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:45.512482 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Detaching volume 97347d8a-d57e-4631-bdc4-4b1f7aaf2a35
May 26 05:19:45.544791 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to driver detach volume 97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 from mountpoint /dev/vdc
May 26 05:19:45.569885 np0000001388 nova-compute[98319]: DEBUG os_brick.encryptors [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Using volume encryption metadata '{'encryption_key_id': '00000000-0000-0000-0000-000000000000', 'control_location': 'front-end', 'cipher': 'aes-xts-plain64', 'key_size': 256, 'provider': 'luks'}' for connection: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, 'status': 'reserved', 'instance': '25b52548-45d5-4109-bd5b-d7851c560095', 'attached_at': '', 'detached_at': '', 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'serial': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'} {{(pid=98319) get_encryption_metadata /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/encryptors/__init__.py:133}}
May 26 05:19:45.573079 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdc by alias ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:45.574167 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdc by alias ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:45.574338 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Attempting to detach device vdc from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:19:45.574537 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <alias name="ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <serial>97347d8a-d57e-4631-bdc4-4b1f7aaf2a35</serial>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="0480857a-a437-4938-8887-3832ad5e3ce1"/>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:45.574537 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:45.579948 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdc from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config.
May 26 05:19:45.580080 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] (1/8): Attempting to detach device vdc with device alias ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:19:45.580295 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <alias name="ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <source dev="/dev/disk/by-id/os-brick+dev+dm-0"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <target dev="vdc" bus="virtio"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <serial>97347d8a-d57e-4631-bdc4-4b1f7aaf2a35</serial>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   <encryption format="luks">
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:     <secret type="passphrase" uuid="0480857a-a437-4938-8887-3832ad5e3ce1"/>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:   </encryption>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:45.580295 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:45.868513 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6cbc10bd-4c6c-4e22-9b23-6bf224c2dd6a tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.901s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:45.966877 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:46.015027 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772786.0147405, 25b52548-45d5-4109-bd5b-d7851c560095 => ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:19:46.016114 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 for instance 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:19:46.018066 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdc from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config.
May 26 05:19:46.020099 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:19:46.020351 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/disk/by-id/os-brick+dev+dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:46.020497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:46.020761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:46.020996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': True, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:19:46.021114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:46.050678 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [199] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [200] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:46.051018 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '199'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '200'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:19:46.051018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '200')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:46.052038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35', '199')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:46.052873 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4588c20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:19:46.053049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:19:46.053276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flush multipath device 330000000cee9ae13 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:19:46.081597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:46.114420 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:46.151439 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:19:46.151579 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:19:46.152841 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:19:46.162934 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:19:46.163107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:19:46.174447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.215985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 200, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.40.100,3260]
May 26 05:19:46.215985 np0000001388 nova-compute[98319]: Logout of [sid: 200, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.40.100,3260] successful.
May 26 05:19:46.215985 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.236113 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.246465 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.282259 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 199, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.50.100,3260]
May 26 05:19:46.282259 np0000001388 nova-compute[98319]: Logout of [sid: 199, target: iqn.2023-03.storpool.com:os--volume-97347d8a-d57e-4631-bdc4-4b1f7aaf2a35, portal: 192.168.50.100,3260] successful.
May 26 05:19:46.282259 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.302076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:46.303144 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:46.303277 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== disconnect_volume: return (282ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:46.303380 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:19:46.843253 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:47.313477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:47.313659 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:47.816739 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:47.849861 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-57716c51-4e99-499d-b6a8-b9e03331e510 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.839s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:47.877909 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:48.256344 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:48.256580 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:48.759002 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Detaching volume 61682cd4-1542-4b89-a33e-82b32f9a2f48
May 26 05:19:48.794785 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Attempting to driver detach volume 61682cd4-1542-4b89-a33e-82b32f9a2f48 from mountpoint /dev/vdb
May 26 05:19:48.799234 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-61682cd4-1542-4b89-a33e-82b32f9a2f48 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:48.800661 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-61682cd4-1542-4b89-a33e-82b32f9a2f48 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:19:48.800768 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Attempting to detach device vdb from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:19:48.800971 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <alias name="ua-61682cd4-1542-4b89-a33e-82b32f9a2f48"/>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <serial>61682cd4-1542-4b89-a33e-82b32f9a2f48</serial>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:48.800971 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:48.806393 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the persistent domain config.
May 26 05:19:48.806495 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] (1/8): Attempting to detach device vdb with device alias ua-61682cd4-1542-4b89-a33e-82b32f9a2f48 from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:19:48.806702 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <alias name="ua-61682cd4-1542-4b89-a33e-82b32f9a2f48"/>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-4"/>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <serial>61682cd4-1542-4b89-a33e-82b32f9a2f48</serial>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:48.806702 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:19:48.822477 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.509s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:49.243952 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772789.2435937, 25b52548-45d5-4109-bd5b-d7851c560095 => ua-61682cd4-1542-4b89-a33e-82b32f9a2f48> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:19:49.245048 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-61682cd4-1542-4b89-a33e-82b32f9a2f48 for instance 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:19:49.247218 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance 25b52548-45d5-4109-bd5b-d7851c560095 from the live domain config.
May 26 05:19:49.248332 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:19:49.248584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:49.248726 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:49.249037 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:49.249296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '61682cd4-1542-4b89-a33e-82b32f9a2f48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:19:49.249412 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:49.275994 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [197] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [198] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48 (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:49.276449 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:19:49.276449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '197')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:49.277375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48', '198')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:19:49.278161 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa458bf60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:19:49.278370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:19:49.278576 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flush multipath device 330000000ebce8908 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:19:49.307527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:49.349749 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:19:49.397705 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:19:49.397921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:19:49.400325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:19:49.410500 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:19:49.410812 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:19:49.424134 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.456032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 197, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.40.100,3260]
May 26 05:19:49.456032 np0000001388 nova-compute[98319]: Logout of [sid: 197, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.40.100,3260] successful.
May 26 05:19:49.456032 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.473864 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.485368 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.519213 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 198, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.50.100,3260]
May 26 05:19:49.519213 np0000001388 nova-compute[98319]: Logout of [sid: 198, target: iqn.2023-03.storpool.com:os--volume-61682cd4-1542-4b89-a33e-82b32f9a2f48, portal: 192.168.50.100,3260] successful.
May 26 05:19:49.519213 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.537736 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:49.537962 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:49.538084 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== disconnect_volume: return (289ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:49.538271 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:19:49.893416 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:49.893524 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:49.893722 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attaching volume 7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 to /dev/vdb
May 26 05:19:49.925943 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:49.938171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:19:49.959528 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:19:50.007244 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:19:50.007584 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:19:50.016272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:19:50.017495 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe22:824b', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f', 'fe80::fc16:3eff:feaa:6832'] 
May 26 05:19:50.017602 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:19:50.017731 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:19:50.017977 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:50.018241 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating existing volume attachment record: 40ed6597-810f-4be9-98f3-f9bc12f273b7 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:19:50.092007 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:50.454447 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005998670003464213 future=<Future at 0x7d7aa43d1670 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:50.455239 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Emitting event <LifecycleEvent: 1779772775.4537323, 26e37518-d43d-4b89-b932-444fbafdd638 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:19:50.455440 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:50.455623 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] VM Stopped (Lifecycle Event)
May 26 05:19:50.571256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:19:50.571567 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:19:50.571692 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:50.572171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:50.572370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:19:50.583043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:50.583592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:19:50.584014 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:50.584173 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:50.584569 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:19:50.584752 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:50.599752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:50.599752 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:50.605308 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:19:50.605308 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:50.612453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2] added
May 26 05:19:50.612453 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:50.612453 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:50.612453 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:50.612453 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:50.612453 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:50.612453 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:50.612664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:50.612885 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0286(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:50.612931 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:50.617323 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2] added
May 26 05:19:50.617323 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:19:50.617323 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:50.617323 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:50.617323 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:19:50.617323 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:19:50.617323 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:50.617499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:19:50.617645 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0328(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:19:50.617789 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:19:50.948298 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:50.948501 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:19:50.948981 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.67 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:19:50.959429 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 26e37518-d43d-4b89-b932-444fbafdd638] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:19:50.969421 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:51.103688 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-91ecdf3d-8cdf-44cb-b39e-84488feeec97 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.847s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:51.613452 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:19:51.618218 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:51.626476 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:51.626476 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:19:51.632680 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:19:51.632680 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.640821 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.648456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.657810 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.658158 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.667050 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.667291 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:51.701734 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.50.100,3260]
May 26 05:19:51.701734 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.50.100,3260] successful.
May 26 05:19:51.701734 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.710818 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.40.100,3260]
May 26 05:19:51.710818 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.40.100,3260] successful.
May 26 05:19:51.710818 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.716220 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.722789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.735314 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.735594 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:51.735760 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:51.735924 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:51.737468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('7', '-', '-', 0) found on session 213 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:51.737611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.742890 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:19:51.743116 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:19:51.743387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.159s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:51.743538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:19:51.744686 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('8', '-', '-', 0) found on session 214 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:19:51.744814 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:19:51.753022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 213 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:51.753022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:51.763884 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 214 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:19:51.764095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:19:52.584352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:19:52.879593 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:53.600942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found WWN 330000000889b4c0b for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:19:53.601263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:19:53.601541 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== connect_volume: return (3029ms) {'type': 'block', 'scsi_wwn': '330000000889b4c0b', 'path': '/dev/dm-0', 'multipath_id': '330000000889b4c0b'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:19:53.601635 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000889b4c0b', 'path': '/dev/dm-0', 'multipath_id': '330000000889b4c0b'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:19:53.604543 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:54.107468 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to attach volume 7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:19:54.108777 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:   <alias name="ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2"/>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:   <serial>7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2</serial>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]: </disk>
May 26 05:19:54.108777 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:19:54.881793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:54.881793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:54.881793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:54.881793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:54.881793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:54.882794 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Terminating instance
May 26 05:19:55.387016 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:19:55.405997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:55.425477 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:55.435129 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:55.454614 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:55.576496 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:55.576669 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:55.576853 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:55.577039 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:55.577358 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] No waiting events found dispatching network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:55.577421 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3755e7f4-e758-4b6b-bc18-aafa11f80e36 req-86fd63ba-03b0-4672-b3a6-11d3e54b5ddf service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:19:55.715425 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99972500099966 future=<Future at 0x7d7aa4241400 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:55.715910 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999252426999647 future=<Future at 0x7d7aa4241400 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:55.716010 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999107468999682 future=<Future at 0x7d7aa4241400 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:19:55.718675 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Instance destroyed successfully.
May 26 05:19:55.719274 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'resources' on Instance uuid 25b52548-45d5-4109-bd5b-d7851c560095 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:19:55.777223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:55.777223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:55.777223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:19:55.777223 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No VIF found with MAC fa:16:3e:22:4e:d6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:19:55.970772 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:56.221484 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:16:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-355136792',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-355136792',id=69,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGWVt4KBACcrPto+SZJnay1pvJOmz4IrYtt3eeIelma4G7U/7KN8fksYmvSFCgRr/XWm9PT24cS1+a0CDnssP35pKTwoyIdLDZ4wNzu/FwOpFR5oFlSbgThWBVSZbGfRbg==',key_name='tempest-keypair-1570414107',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:17:09Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-0z2hi7kq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:17:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=25b52548-45d5-4109-bd5b-d7851c560095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:19:56.221859 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "address": "fa:16:3e:22:82:4b", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap896b9d6e-f7", "ovs_interfaceid": "896b9d6e-f7a4-431c-8618-e3d6812c77a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:19:56.222174 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:19:56.222422 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:19:56.223693 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:56.224025 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap896b9d6e-f7, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:56.225060 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:56.225925 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:56.227495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:56.227685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36043c70-2c7a-4f0f-a5b3-9bd52eb4bf68) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:19:56.228211 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:56.229304 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:19:56.230820 np0000001388 nova-compute[98319]: INFO os_vif [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:82:4b,bridge_name='br-int',has_traffic_filtering=True,id=896b9d6e-f7a4-431c-8618-e3d6812c77a0,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap896b9d6e-f7')
May 26 05:19:56.231092 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Deleting instance files /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095_del
May 26 05:19:56.231825 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Deletion of /opt/stack/data/nova/instances/25b52548-45d5-4109-bd5b-d7851c560095_del complete
May 26 05:19:56.737378 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:19:56.738007 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:19:56.738108 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:19:56.738230 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:19:56.738496 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:56.831315 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:19:57.325004 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-80bd346c-953e-47b1-8a4b-08168463286f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.431s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:57.580778 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:19:57.648021 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:57.648189 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] Acquiring lock "25b52548-45d5-4109-bd5b-d7851c560095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:57.648356 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:57.648464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] Lock "25b52548-45d5-4109-bd5b-d7851c560095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:57.648584 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] No waiting events found dispatching network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:19:57.648702 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-unplugged-896b9d6e-f7a4-431c-8618-e3d6812c77a0 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:19:57.648777 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-cb2de522-82d0-47e0-8757-9d2789eef7e5 req-7c2205bc-82db-4b1d-acd3-d0084a5d2467 service nova] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Received event network-vif-deleted-896b9d6e-f7a4-431c-8618-e3d6812c77a0 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:19:57.880894 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:19:58.082707 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Took 1.34 seconds to deallocate network for instance.
May 26 05:19:58.588368 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:19:58.588517 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:19:58.887282 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:19:58.887658 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:19:59.389870 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:19:59.895590 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:19:59.953528 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Deleted allocations for instance 25b52548-45d5-4109-bd5b-d7851c560095
May 26 05:20:00.883276 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:00.883552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:00.964318 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c61ac3f5-351c-4dd9-b358-d4e3de2d9a1f tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "25b52548-45d5-4109-bd5b-d7851c560095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.084s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:01.228943 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:01.385884 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Detaching volume 7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2
May 26 05:20:01.444662 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to driver detach volume 7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 from mountpoint /dev/vdb
May 26 05:20:01.450901 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:01.452976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:01.452976 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Attempting to detach device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:20:01.453108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <alias name="ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2"/>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <serial>7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2</serial>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:01.453108 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:01.461809 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config.
May 26 05:20:01.462108 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] (1/8): Attempting to detach device vdb with device alias ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:20:01.462559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <alias name="ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2"/>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <serial>7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2</serial>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:01.462559 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:01.986503 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772801.986145, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:20:01.987800 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 for instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:20:01.992566 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config.
May 26 05:20:01.993570 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:01.993896 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:01.994038 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:01.994430 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:01.994699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:01.994849 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:20:02.029519 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [213] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: tcp: [214] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2 (non-flash)
May 26 05:20:02.029819 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:02.029819 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', '213'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', '214')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:02.030053 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', '214')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:02.030802 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2', '213')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:02.033427 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4589bc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:02.033611 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:02.033872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flush multipath device 330000000889b4c0b {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:02.069513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:02.113679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:02.170666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:02.170866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:02.172163 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:02.182890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:02.183145 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:02.194791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.231050 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 214, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.40.100,3260]
May 26 05:20:02.231050 np0000001388 nova-compute[98319]: Logout of [sid: 214, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.40.100,3260] successful.
May 26 05:20:02.231050 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.249459 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.263571 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.296621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 213, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.50.100,3260]
May 26 05:20:02.296621 np0000001388 nova-compute[98319]: Logout of [sid: 213, target: iqn.2023-03.storpool.com:os--volume-7c10cad0-bd3d-48b6-9b16-e437d6ec9fe2, portal: 192.168.50.100,3260] successful.
May 26 05:20:02.296621 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.315292 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:02.315528 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:02.315667 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== disconnect_volume: return (322ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:02.315814 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:02.868898 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:02.882573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:03.683927 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:03.874221 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7beda9bc-accc-4213-beb7-2f9c877d0070 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.991s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:05.272377 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:05.272713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:05.283493 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:05.283715 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:05.324732 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:05.324902 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:05.774361 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:20:05.785580 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:20:05.827661 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:06.230548 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:06.339913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:06.339913 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:06.343542 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:20:06.343663 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Claim successful on node np0000001388
May 26 05:20:06.359897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:06.833409 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.508s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:07.318420 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:07.318584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:07.318799 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:07.318972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:07.319121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:07.320974 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Terminating instance
May 26 05:20:07.700805 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:07.701312 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:07.824540 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:20:07.839236 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.841671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.856482 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.885404 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.956960 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:07.957155 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:07.957423 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attaching volume cc0ef293-8168-43e4-9207-70b593eaa787 to /dev/vdb
May 26 05:20:07.962833 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:07.962914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:07.963277 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:07.963667 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:07.964034 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] No waiting events found dispatching network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:07.964257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-fe77dc7c-7992-46b7-8783-6db1c60c6804 req-1e1f4ef8-14d9-4294-8d30-f27d0c660049 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:07.980557 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.986420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:07.996811 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:08.007621 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:20:08.029619 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:08.075074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:20:08.075425 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:20:08.084432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:20:08.085627 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f'] 
May 26 05:20:08.085791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:20:08.085843 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:20:08.086080 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== get_connector_properties: return (89ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:08.086347 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating existing volume attachment record: b7c54e5a-0a50-4eb6-a3fe-7016f24e24dd {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:20:08.145076 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999540500000421 future=<Future at 0x7d7ac43dc410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:08.146506 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Instance destroyed successfully.
May 26 05:20:08.146585 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 38cb43d7-d96c-48d7-ab0a-1890f44e8956 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:08.203470 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:08.633810 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:20:08.634284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:08.634437 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:08.634874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:08.635027 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:20:08.646045 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:08.646493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:08.646961 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:08.647252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:08.647416 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:08.647643 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:08.649216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:19:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-292679573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-image-snapshot-server-292679573',id=76,image_ref='7a59af43-c603-4603-9e2d-534337efa761',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB2SX8fNLfF6WvWl/Z8BOnSFaPgzm5FxT2T7D5chztYzyiInNGNZScf8sqEAcNfTzATv/9LW/LMi/yee9xnaN/2ELglTKhB6j9iRJT8WvPDcJCQUsyyYlkbwLOgKPmCavw==',key_name='tempest-keypair-98781848',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:19:29Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zx70zt0m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='raw',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-877823063',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:19:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=38cb43d7-d96c-48d7-ab0a-1890f44e8956,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:20:08.649418 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "address": "fa:16:3e:aa:68:32", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.253", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2d55d57-fe", "ovs_interfaceid": "d2d55d57-fe44-41d7-887b-0f7d1926b721", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:08.650097 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:08.650401 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:20:08.651831 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.652116 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2d55d57-fe, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:08.653315 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.654463 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:08.654591 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.655308 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.655477 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f177c3e4-8f89-49e4-885b-00afb469c03e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:08.656111 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.656715 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:08.656792 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:08.658382 np0000001388 nova-compute[98319]: INFO os_vif [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:68:32,bridge_name='br-int',has_traffic_filtering=True,id=d2d55d57-fe44-41d7-887b-0f7d1926b721,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2d55d57-fe')
May 26 05:20:08.659647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:08.659647 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:08.660010 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:08.660317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:08.660570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:08.664230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:08.664230 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:08.670606 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787] added
May 26 05:20:08.670606 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:08.670606 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:08.670606 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:08.670606 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:08.670606 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:08.670606 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:08.670850 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:08.670907 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0236(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:08.671037 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:08.677510 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787] added
May 26 05:20:08.677510 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:08.677510 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:08.677510 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:08.677510 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:08.677510 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:08.677510 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:08.677737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:08.677737 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0303(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:08.677854 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:08.710594 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.371s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:08.711045 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:20:08.713287 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.353s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:08.717866 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:20:08.718246 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Claim successful on node np0000001388
May 26 05:20:09.217692 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:20:09.218646 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:20:09.218646 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:09.218925 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:09.281454 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3ee150517d34539b56afa2c9433e087', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56542810ab5d4dd9b443231e8931b871', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:20:09.671491 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:09.678473 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:09.683637 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:09.683637 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:09.691952 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:09.691952 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.697164 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.703585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.711517 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.712378 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:09.717649 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Successfully created port: 4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:20:09.719429 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.722147 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:09.749598 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.50.100,3260]
May 26 05:20:09.749598 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.50.100,3260] successful.
May 26 05:20:09.749598 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.761180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.773592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.40.100,3260]
May 26 05:20:09.773592 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.40.100,3260] successful.
May 26 05:20:09.773592 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.778493 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.778862 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:09.779156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.132s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:09.779156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:09.780189 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('7', '-', '-', 0) found on session 215 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:09.780337 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:09.786404 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:09.797476 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 215 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:09.797656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.803482 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:09.803714 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:09.803999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.157s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:09.803999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:09.805083 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('8', '-', '-', 0) found on session 216 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:09.805248 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:09.818367 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 216 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:09.818367 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:10.017036 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:10.017418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] Acquiring lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:10.017552 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:10.017694 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:10.017865 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] No waiting events found dispatching network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:10.017991 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8aa8c817-2ff5-4920-a2cf-26c27e96c793 req-6ff4cbac-627a-450c-9d3e-b2e2331f5bdf service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-unplugged-d2d55d57-fe44-41d7-887b-0f7d1926b721 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:10.072188 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:10.072404 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:10.169560 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Successfully updated port: 4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:20:10.208614 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-changed-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:10.208758 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Refreshing instance network info cache due to event network-changed-4dbd9514-a7ee-4751-af44-6cde5e09729c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:10.208914 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] Acquiring lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:10.209006 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] Acquired lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:10.209136 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Refreshing network info cache for port 4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:10.222843 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:20:10.574822 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:10.647709 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:20:10.671806 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:10.711478 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:10.715443 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0002894830004152027 future=<Future at 0x7d7aa4241400 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:10.715889 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772795.715068, 25b52548-45d5-4109-bd5b-d7851c560095 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:10.716060 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:10.716255 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] VM Stopped (Lifecycle Event)
May 26 05:20:10.716371 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.428193601000203 future=<Future at 0x7d7ac43dc410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:10.717154 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=12.4274121440003 future=<Future at 0x7d7ac43dc410 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:10.766906 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:10.883888 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:11.080745 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.368s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:11.081030 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:20:11.218714 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 25b52548-45d5-4109-bd5b-d7851c560095] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:11.229190 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:20:11.230151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:20:11.230370 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Creating image(s)
May 26 05:20:11.230811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:11.230953 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:11.231382 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:11.231844 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:20:11.234124 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:20:11.234974 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:11.317461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.082s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:11.317900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:11.318404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:11.318899 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:20:11.321244 np0000001388 nova-compute[98319]: DEBUG oslo_utils.imageutils.format_inspector [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98319) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1538}}
May 26 05:20:11.321540 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:11.386149 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-d39d2763-152b-42b9-a525-0463465439ec req-cffcf414-26a0-423f-8fb7-6f7855edb2e8 service nova] Releasing lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:11.386761 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquired lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:11.387002 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:20:11.408395 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.087s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:11.408830 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk 1073741824 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:11.468920 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d,backing_fmt=raw /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk 1073741824" returned: 0 in 0.060s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:11.469328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "80d0c39aa3473cec9f1d5562a48f051d7e68956d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.151s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:11.469654 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:11.555471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/80d0c39aa3473cec9f1d5562a48f051d7e68956d --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:11.556006 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk. size=1073741824 {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}}
May 26 05:20:11.556402 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:11.593288 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:20:11.593622 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:20:11.594286 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:11.594702 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:11.640965 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:11.641357 np0000001388 nova-compute[98319]: DEBUG nova.virt.disk.api [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Cannot resize image /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk to a smaller size. {{(pid=98319) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}}
May 26 05:20:11.641625 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Created local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5347}}
May 26 05:20:11.641787 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Ensure instance console log exists: /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:20:11.642058 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:11.642284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:11.642404 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:11.662805 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found WWN 330000000eacaa4ee for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:20:11.663230 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:11.663585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '330000000eacaa4ee', 'path': '/dev/dm-0', 'multipath_id': '330000000eacaa4ee'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:11.667221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.004s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:11.667657 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000eacaa4ee', 'path': '/dev/dm-0', 'multipath_id': '330000000eacaa4ee'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:20:11.667860 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5818c10abb5d4f01b76e07eabdde16c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6588fb6c3894fadbc7f9ded9103be11', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:20:11.669150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '20802b6a-f648-434f-9976-0b59414db7fc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-12'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:11.669332 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:11.673243 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:11.702303 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [209] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [210] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:11.702593 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:11.702593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '216')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:11.702853 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '209')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:11.703707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc', '210')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:11.704531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46dbd80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'): ({'sdo'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:11.704744 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sdn, sdo {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:11.705171 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 3300000004dbcfcf1 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:11.780583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:11.824627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:11.865431 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:11.865628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:11.866776 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:11.878688 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:11.878889 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:11.889285 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.920513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 209, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.40.100,3260]
May 26 05:20:11.920513 np0000001388 nova-compute[98319]: Logout of [sid: 209, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.40.100,3260] successful.
May 26 05:20:11.920513 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.939261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.947455 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:11.950315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.981389 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 210, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.50.100,3260]
May 26 05:20:11.981389 np0000001388 nova-compute[98319]: Logout of [sid: 210, target: iqn.2023-03.storpool.com:os--volume-20802b6a-f648-434f-9976-0b59414db7fc, portal: 192.168.50.100,3260] successful.
May 26 05:20:11.981389 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.998756 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:11.998986 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:11.999099 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (3338ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:11.999222 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:11.999499 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Deleting instance files /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956_del
May 26 05:20:12.000579 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Deletion of /opt/stack/data/nova/instances/38cb43d7-d96c-48d7-ab0a-1890f44e8956_del complete
May 26 05:20:12.050277 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Successfully created port: 9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:20:12.098405 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:20:12.111462 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:12.176530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to attach volume cc0ef293-8168-43e4-9207-70b593eaa787 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:20:12.177872 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:   <alias name="ua-cc0ef293-8168-43e4-9207-70b593eaa787"/>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:   <serial>cc0ef293-8168-43e4-9207-70b593eaa787</serial>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:12.177872 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:20:12.228384 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating instance_info_cache with network_info: [{"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:12.509489 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Took 4.68 seconds to destroy the instance on the hypervisor.
May 26 05:20:12.512052 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Successfully updated port: 9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:20:12.513357 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:20:12.515327 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:20:12.515414 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:20:12.515617 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:12.567473 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-changed-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:12.567473 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Refreshing instance network info cache due to event network-changed-9049a94b-cfeb-4292-89a1-3a080cde4359. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:12.567473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] Acquiring lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:12.567473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] Acquired lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:12.567473 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Refreshing network info cache for port 9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:12.602408 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:20:12.638474 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:12.730354 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Releasing lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:12.730662 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance network_info: |[{"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:20:12.732386 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Start _get_guest_xml network_info=[{"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'disk_bus': 'virtio', 'guest_format': None, 'encryption_secret_uuid': None, 'device_type': 'disk', 'encrypted': False, 'encryption_options': None, 'device_name': '/dev/vda', 'encryption_format': None, 'boot_index': 0, 'size': 0, 'image_id': 'eb1b37ef-ecaa-41a5-b927-a074eae64cb1'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:20:12.734956 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:20:12.736169 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', instance_meta=NovaInstanceMeta(name='tempest-VolumeMultiattachTests-server-597614084', uuid='e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1'), owner=OwnerMeta(userid='a3ee150517d34539b56afa2c9433e087', username='tempest-VolumeMultiattachTests-2100574999-project-member', projectid='56542810ab5d4dd9b443231e8931b871', projectname='tempest-VolumeMultiattachTests-2100574999'), image=ImageMeta(id='eb1b37ef-ecaa-41a5-b927-a074eae64cb1', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772812.7357886) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:20:12.737565 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:20:12.737920 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:20:12.738890 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:20:12.739116 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:20:12.740262 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:20:12.740740 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-05-26T04:55:43Z,direct_url=<?>,disk_format='qcow2',id=eb1b37ef-ecaa-41a5-b927-a074eae64cb1,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='928da787e7674569a05e80c64a345a3e',properties=ImageMetaProps,protected=<?>,size=21692416,status='active',tags=<?>,updated_at=2026-05-26T04:55:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:20:12.740880 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:20:12.740968 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:20:12.741081 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:20:12.741153 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:20:12.741273 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:20:12.741522 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:20:12.741616 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:20:12.741725 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:20:12.741873 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:20:12.741941 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:20:12.752606 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-597614084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-597614084',id=77,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowCextoahFsErLVOKsExE8w0X1lULixXw1KtYPfYkUnEEHi0svpgjQd/fWng1FLMU7mtmCzoKmhcMshx9F4O1t5QomUEt9s8JLWQI68B5B02W/F17iUkSoJxoj3d3GaA==',key_name='tempest-keypair-1764222304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-mwfys1mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:20:12.752790 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:12.753330 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:12.753821 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'pci_devices' on Instance uuid e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:13.015180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:13.022629 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49035ff9-2117-4ef5-b9ab-cedc6d7f3c7a req-08c62aae-8535-415e-9f9b-f7108d5ef843 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Received event network-vif-deleted-d2d55d57-fe44-41d7-887b-0f7d1926b721 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:13.023219 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-49035ff9-2117-4ef5-b9ab-cedc6d7f3c7a req-08c62aae-8535-415e-9f9b-f7108d5ef843 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Neutron deleted interface d2d55d57-fe44-41d7-887b-0f7d1926b721; detaching it from the instance and deleting it from the info cache
May 26 05:20:13.023453 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-49035ff9-2117-4ef5-b9ab-cedc6d7f3c7a req-08c62aae-8535-415e-9f9b-f7108d5ef843 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:13.069139 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:13.106275 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Booting with volume bde5e33a-e9ba-41fc-b1b7-cfe06d539259 at /dev/vda
May 26 05:20:13.122078 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:13.137017 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:13.146223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:20:13.165473 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:13.209429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:20:13.209668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:20:13.217707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:20:13.218770 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fefc:9240', 'fe80::5ca0:c8ff:fef8:5735', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f'] 
May 26 05:20:13.218917 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:20:13.219052 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:20:13.219344 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== get_connector_properties: return (81ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:13.219598 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating existing volume attachment record: b56722fc-4c20-43f5-a3aa-7ae5154de2b8 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:20:13.252852 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:13.256830 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] End _get_guest_xml xml=<domain type="qemu">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <uuid>e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1</uuid>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <name>instance-0000004d</name>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:name>tempest-VolumeMultiattachTests-server-597614084</nova:name>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:20:12</nova:creationTime>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:image uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:containerFormat>bare</nova:containerFormat>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:diskFormat>qcow2</nova:diskFormat>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:user uuid="a3ee150517d34539b56afa2c9433e087">tempest-VolumeMultiattachTests-2100574999-project-member</nova:user>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:project uuid="56542810ab5d4dd9b443231e8931b871">tempest-VolumeMultiattachTests-2100574999</nova:project>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:root type="image" uuid="eb1b37ef-ecaa-41a5-b927-a074eae64cb1"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         <nova:port uuid="4dbd9514-a7ee-4751-af44-6cde5e09729c">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.14" ipVersion="4"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <system>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="serial">e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="uuid">e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </system>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <os>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </os>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <features>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </features>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   <devices>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <disk type="file" device="disk">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <driver name="qemu" type="qcow2" cache="none"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.config"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:f1:ba:f1"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <target dev="tap4dbd9514-a7"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </interface>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/console.log" append="off"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </serial>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <video>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </video>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </rng>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:   </devices>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]: </domain>
May 26 05:20:13.256830 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Preparing to wait for external event network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-597614084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-597614084',id=77,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowCextoahFsErLVOKsExE8w0X1lULixXw1KtYPfYkUnEEHi0svpgjQd/fWng1FLMU7mtmCzoKmhcMshx9F4O1t5QomUEt9s8JLWQI68B5B02W/F17iUkSoJxoj3d3GaA==',key_name='tempest-keypair-1764222304',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-mwfys1mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.260090 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:13.260656 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:20:13.262439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.262439 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '13281bb7-055b-56c3-8439-42fc88b92c47', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:13.275316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.276443 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:13.278886 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.279106 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4dbd9514-a7, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:13.280165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4dbd9514-a7, col_values=(('qos', UUID('b35fa498-a246-4cf9-9ad4-5383c34405a9')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:13.280165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4dbd9514-a7, col_values=(('external_ids', {'iface-id': '4dbd9514-a7ee-4751-af44-6cde5e09729c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:ba:f1', 'vm-uuid': 'e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:13.280560 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.282122 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:13.286229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:13.287312 np0000001388 nova-compute[98319]: INFO os_vif [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7')
May 26 05:20:13.482394 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:13.526386 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-49035ff9-2117-4ef5-b9ab-cedc6d7f3c7a req-08c62aae-8535-415e-9f9b-f7108d5ef843 service nova] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Detach interface failed, port_id=d2d55d57-fe44-41d7-887b-0f7d1926b721, reason: Instance 38cb43d7-d96c-48d7-ab0a-1890f44e8956 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:20:13.755245 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-aa00aefc-65a6-4efe-a09e-451b1c0ce352 req-a5e73dad-59a1-40dd-a9f4-a9ef4814e743 service nova] Releasing lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:13.756137 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquired lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:13.756137 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:20:13.818658 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:13.818856 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:13.818981 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:13.819133 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No VIF found with MAC fa:16:3e:22:4e:d6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:13.984728 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Took 1.47 seconds to deallocate network for instance.
May 26 05:20:14.313037 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:14.447953 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:14.525495 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:20:14.527544 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Deleting volume: 20802b6a-f648-434f-9976-0b59414db7fc {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:20:14.563847 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating instance_info_cache with network_info: [{"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:14.808822 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:14.809000 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:14.809146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:f1:ba:f1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:14.809753 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Using config drive
May 26 05:20:15.061283 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:15.061418 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:15.065862 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Releasing lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:15.066212 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance network_info: |[{"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:20:15.308009 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:20:15.308986 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:20:15.309232 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Creating image(s)
May 26 05:20:15.309484 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:20:15.309603 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Ensure instance console log exists: /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:20:15.309935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:15.310075 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:15.310180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:15.310601 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Start _get_guest_xml network_info=[{"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'b56722fc-4c20-43f5-a3aa-7ae5154de2b8', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a', 'attached_at': '', 'detached_at': '', 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'serial': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:20:15.315481 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:15.317093 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:20:15.318827 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPatternV346-server-1110005998', uuid='ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a'), owner=OwnerMeta(userid='5818c10abb5d4f01b76e07eabdde16c1', username='tempest-TestVolumeBootPatternV346-1982355268-project-member', projectid='a6588fb6c3894fadbc7f9ded9103be11', projectname='tempest-TestVolumeBootPatternV346-1982355268'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772815.3184001) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:20:15.320069 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:20:15.320421 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:20:15.321528 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:20:15.324183 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:20:15.325032 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:20:15.325340 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:20:15.325527 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:20:15.325662 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:20:15.325841 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:20:15.326069 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:20:15.326215 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:20:15.326402 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:20:15.326541 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:20:15.326698 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:20:15.326834 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:20:15.326986 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:20:15.335716 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:20:15.336032 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:15.336209 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:15.336520 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:15.336739 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:20:15.347940 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:15.348543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:15.348967 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:15.349127 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:15.349513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:15.349981 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:15.361312 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:15.361312 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:15.367030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:15.367030 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:15.368067 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a6b2cf77-0865-4de3-8052-39ac575509bf tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.411s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:15.374225 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:15.374420 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:15.376272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259] added
May 26 05:20:15.376272 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:15.376272 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:15.376272 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:15.376272 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:15.376272 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:15.376272 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:15.376499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:15.376679 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:15.376969 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:15.382885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259] added
May 26 05:20:15.382885 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:15.382885 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:15.382885 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:15.382885 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:15.382885 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:15.382885 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:15.383216 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:15.383417 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0337(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:15.383554 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:15.433313 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Creating config drive at /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.config
May 26 05:20:15.437180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hj9l2ym {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:15.493078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp0hj9l2ym" returned: 0 in 0.056s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:15.873164 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:15.879242 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:15.889902 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:15.892861 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:15.988420 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:16.023309 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94a5f5d4-7b13-47cf-9045-d0db4d15ffc2 req-de9c4549-ca33-447d-b335-1e5ff1c69bf3 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:16.023828 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94a5f5d4-7b13-47cf-9045-d0db4d15ffc2 req-de9c4549-ca33-447d-b335-1e5ff1c69bf3 service nova] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:16.024032 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94a5f5d4-7b13-47cf-9045-d0db4d15ffc2 req-de9c4549-ca33-447d-b335-1e5ff1c69bf3 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:16.024169 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-94a5f5d4-7b13-47cf-9045-d0db4d15ffc2 req-de9c4549-ca33-447d-b335-1e5ff1c69bf3 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:16.024955 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-94a5f5d4-7b13-47cf-9045-d0db4d15ffc2 req-de9c4549-ca33-447d-b335-1e5ff1c69bf3 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Processing event network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:20:16.202560 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:16.219478 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:16.228573 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:16.377239 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:16.384057 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:16.389513 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:16.389513 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.392491 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.331s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:16.397223 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:16.397223 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.402944 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.410087 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.420566 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.420804 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.427752 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.427929 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:16.444845 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 38cb43d7-d96c-48d7-ab0a-1890f44e8956
May 26 05:20:16.472362 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.40.100,3260]
May 26 05:20:16.472362 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.40.100,3260] successful.
May 26 05:20:16.472362 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.481438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.50.100,3260]
May 26 05:20:16.481438 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.50.100,3260] successful.
May 26 05:20:16.481438 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.484902 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.492817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.506784 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.507155 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:16.507155 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:16.507571 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:16.508176 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('11', '-', '-', 0) found on session 217 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:16.508310 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.512458 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:16.512809 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:16.513107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:16.513107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:16.514244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] HCTL ('12', '-', '-', 0) found on session 218 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:16.514383 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:16.520701 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 217 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:16.520872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:16.530506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 218 and hctl ['12', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:16.627802 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772816.6272151, e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:16.628610 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:20:16.629443 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] VM Started (Lifecycle Event)
May 26 05:20:16.632559 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:20:16.635065 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance spawned successfully.
May 26 05:20:16.635642 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:20:17.131497 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:17.133721 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:17.145868 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.145972 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.146288 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.146522 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.146768 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.147001 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:17.455440 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-5d7bfbfc-f719-44ee-abd9-fcef4e838ffc tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "38cb43d7-d96c-48d7-ab0a-1890f44e8956" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:17.529785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Searching for a device in session 218 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:17.530619 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:17.635970 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:20:17.636209 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772817.636047, e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:17.636329 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] VM Paused (Lifecycle Event)
May 26 05:20:17.651653 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Took 6.42 seconds to spawn the instance on the hypervisor.
May 26 05:20:17.651809 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:17.886444 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:18.079918 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:18.080544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:18.080544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:18.080544 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:18.080738 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] No waiting events found dispatching network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:18.080863 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-e81ad2a6-0755-4378-bebc-41f58208d87b req-0a27ff17-a327-4964-b2a7-bfe03be03dd0 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received unexpected event network-vif-plugged-4dbd9514-a7ee-4751-af44-6cde5e09729c for instance with vm_state active and task_state None.
May 26 05:20:18.138519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:18.140581 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772818.1402445, e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:18.140784 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] VM Resumed (Lifecycle Event)
May 26 05:20:18.160151 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Took 11.88 seconds to build instance.
May 26 05:20:18.291291 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:18.366534 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Found WWN 3300000004bc32f6d for multipath device dm-4 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:20:18.367015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:18.367096 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '3300000004bc32f6d', 'path': '/dev/dm-4', 'multipath_id': '3300000004bc32f6d'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:18.367169 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000004bc32f6d', 'path': '/dev/dm-4', 'multipath_id': '3300000004bc32f6d'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:20:18.604152 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:18.604572 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:18.642860 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:18.644741 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:18.661471 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.389s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:18.851595 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:18.851836 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:18.852037 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:18.852227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:18.852361 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:18.854155 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Terminating instance
May 26 05:20:18.872711 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1110005998',display_name='tempest-TestVolumeBootPatternV346-server-1110005998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1110005998',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlwAbEzwnW/GRf3wacIHBNzPHPdPLCo4joktAju1cBrlrk9keanOFJcvjEKLKt3RHtsfwMSIVHheRF97GlVdFz/bXkvz+zLiXgqq3iAx4iOes8LkpRMIJ8w1tGMPae7tw==',key_name='tempest-keypair-2050122101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-730pai4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:20:18.872980 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:18.873517 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:18.874115 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'pci_devices' on Instance uuid ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:19.109211 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Detaching volume cc0ef293-8168-43e4-9207-70b593eaa787
May 26 05:20:19.147695 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to driver detach volume cc0ef293-8168-43e4-9207-70b593eaa787 from mountpoint /dev/vdb
May 26 05:20:19.152926 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-cc0ef293-8168-43e4-9207-70b593eaa787 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:19.154052 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-cc0ef293-8168-43e4-9207-70b593eaa787 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:19.154226 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Attempting to detach device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:20:19.154445 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <alias name="ua-cc0ef293-8168-43e4-9207-70b593eaa787"/>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <serial>cc0ef293-8168-43e4-9207-70b593eaa787</serial>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:19.154445 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:19.161721 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config.
May 26 05:20:19.161865 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] (1/8): Attempting to detach device vdb with device alias ua-cc0ef293-8168-43e4-9207-70b593eaa787 from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:20:19.162103 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <alias name="ua-cc0ef293-8168-43e4-9207-70b593eaa787"/>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <serial>cc0ef293-8168-43e4-9207-70b593eaa787</serial>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:19.162103 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:19.363184 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-changed-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:19.364014 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Refreshing instance network info cache due to event network-changed-4dbd9514-a7ee-4751-af44-6cde5e09729c. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:19.364014 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] Acquiring lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:19.364014 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] Acquired lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:19.364014 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Refreshing network info cache for port 4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:19.366069 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:20:19.382259 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] End _get_guest_xml xml=<domain type="qemu">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <uuid>ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a</uuid>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <name>instance-0000004e</name>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPatternV346-server-1110005998</nova:name>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:20:15</nova:creationTime>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:user uuid="5818c10abb5d4f01b76e07eabdde16c1">tempest-TestVolumeBootPatternV346-1982355268-project-member</nova:user>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:project uuid="a6588fb6c3894fadbc7f9ded9103be11">tempest-TestVolumeBootPatternV346-1982355268</nova:project>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         <nova:port uuid="9049a94b-cfeb-4292-89a1-3a080cde4359">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.4" ipVersion="4"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <system>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="serial">ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="uuid">ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </system>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <os>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </os>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <features>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </features>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   <devices>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/disk.config"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <alias name="ua-bde5e33a-e9ba-41fc-b1b7-cfe06d539259"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-4"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <serial>bde5e33a-e9ba-41fc-b1b7-cfe06d539259</serial>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:d7:38:91"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <target dev="tap9049a94b-cf"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </interface>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/console.log" append="off"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </serial>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <video>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </video>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </rng>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:   </devices>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]: </domain>
May 26 05:20:19.382259 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Preparing to wait for external event network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1110005998',display_name='tempest-TestVolumeBootPatternV346-server-1110005998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1110005998',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlwAbEzwnW/GRf3wacIHBNzPHPdPLCo4joktAju1cBrlrk9keanOFJcvjEKLKt3RHtsfwMSIVHheRF97GlVdFz/bXkvz+zLiXgqq3iAx4iOes8LkpRMIJ8w1tGMPae7tw==',key_name='tempest-keypair-2050122101',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-730pai4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:19.385584 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:20:19.386119 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.386265 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:19.386527 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:20:19.400756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.400756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c65f1e3-eacc-5145-bbdc-b1a5b6c49752', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:19.404495 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.408426 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:19.425165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.429995 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.430530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9049a94b-cf, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:19.430850 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9049a94b-cf, col_values=(('qos', UUID('ff63ef97-dd44-4784-9df7-a377a378efe8')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:19.431005 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9049a94b-cf, col_values=(('external_ids', {'iface-id': '9049a94b-cfeb-4292-89a1-3a080cde4359', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:38:91', 'vm-uuid': 'ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:19.431910 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.434568 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:19.452125 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.464658 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:19.465696 np0000001388 nova-compute[98319]: INFO os_vif [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf')
May 26 05:20:19.565929 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:19.566604 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:19.566852 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:19.567023 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:19.567183 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] No waiting events found dispatching network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:19.567382 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3db46daf-4607-435b-9268-310fb915fca8 req-cc195d72-a750-4f4e-bd75-07c12e67e20c service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:19.661219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772819.6602728, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => ua-cc0ef293-8168-43e4-9207-70b593eaa787> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:20:19.663561 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-cc0ef293-8168-43e4-9207-70b593eaa787 for instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:20:19.668230 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config.
May 26 05:20:19.669975 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:19.670400 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:19.671590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:19.671590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:19.671590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'cc0ef293-8168-43e4-9207-70b593eaa787', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:19.671803 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:19.706822 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [215] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [216] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:19.707556 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:19.707959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '215'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '216'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:19.707959 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '216')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:19.709182 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787', '215')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:19.712160 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac431e5c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'): ({'sdc'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'): ({'sdb'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:19.712441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:19.712743 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flush multipath device 330000000eacaa4ee {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:19.759338 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:19.793519 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.997549343000173 future=<Future at 0x7d7ac41398b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:19.795077 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Instance destroyed successfully.
May 26 05:20:19.796032 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 5062f735-b5eb-4554-91d6-a1fcff9fc5ec {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:19.801390 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:19.842162 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:19.842162 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:19.843728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:19.857421 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:19.857640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:19.866643 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:19.870028 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:19.920604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 216, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.40.100,3260]
May 26 05:20:19.920604 np0000001388 nova-compute[98319]: Logout of [sid: 216, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.40.100,3260] successful.
May 26 05:20:19.920604 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:19.939677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:19.952308 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:19.991066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 215, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.50.100,3260]
May 26 05:20:19.991066 np0000001388 nova-compute[98319]: Logout of [sid: 215, target: iqn.2023-03.storpool.com:os--volume-cc0ef293-8168-43e4-9207-70b593eaa787, portal: 192.168.50.100,3260] successful.
May 26 05:20:19.991066 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.010039 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.010456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:20.010522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== disconnect_volume: return (339ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:20.010646 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:20.167774 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:20.298289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:18:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-943151440',display_name='tempest-TestVolumeBootPattern-volume-backed-server-943151440',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-volume-backed-server-943151440',id=72,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEG+49iS9bdx8yMECr9wOSpBbnt8fhdac5xzxxKslBis2wQr7ITpJ6Ln7Ur6IICKrgkffYWTOIqImOQnkr8eRp+zJhLqNt75ZnbF2zaEeqcc3Y7RsMX4p+NpKn8ELxPbJg==',key_name='tempest-keypair-28875415',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:18:28Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-zbajxr7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:18:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=5062f735-b5eb-4554-91d6-a1fcff9fc5ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:20:20.298595 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "address": "fa:16:3e:fc:92:40", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap206affcc-e4", "ovs_interfaceid": "206affcc-e4b4-4508-acc1-2a6a3aa3eb5f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:20.299093 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:20.299409 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:20:20.304556 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.304823 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap206affcc-e4, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:20.305865 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.307384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:20.311600 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.312771 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.312918 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e170b59a-389d-409d-b565-68c76b89d4af) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:20.313345 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.313783 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:20.319525 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updated VIF entry in instance network info cache for port 4dbd9514-a7ee-4751-af44-6cde5e09729c. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:20:20.319857 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating instance_info_cache with network_info: [{"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:20.321258 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:20.323098 np0000001388 nova-compute[98319]: INFO os_vif [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:92:40,bridge_name='br-int',has_traffic_filtering=True,id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap206affcc-e4')
May 26 05:20:20.325256 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:20.325638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:20.325829 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:20.326180 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:20.326504 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'e257c900-b4f3-402d-b268-66eebf81eb7a', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-5'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:20.326669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:20.360638 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [203] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [204] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:20.360903 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:20.361135 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:20.361237 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '203')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:20.362219 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a', '204')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:20.362991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa4441a80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:20.363146 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sdi, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:20.363349 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 3300000003b1eb7b8 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:20.428853 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:20.482943 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:20.534593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:20.534817 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:20.536348 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:20.546866 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:20.547157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:20.556565 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.557841 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:20.587582 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 203, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.40.100,3260]
May 26 05:20:20.587582 np0000001388 nova-compute[98319]: Logout of [sid: 203, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.40.100,3260] successful.
May 26 05:20:20.587582 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.606097 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.617241 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.651542 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 204, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.50.100,3260]
May 26 05:20:20.651542 np0000001388 nova-compute[98319]: Logout of [sid: 204, target: iqn.2023-03.storpool.com:os--volume-e257c900-b4f3-402d-b268-66eebf81eb7a, portal: 192.168.50.100,3260] successful.
May 26 05:20:20.651542 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.666467 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:20.666847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:20.666847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (341ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:20.666932 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:20.667170 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Deleting instance files /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec_del
May 26 05:20:20.667633 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Deletion of /opt/stack/data/nova/instances/5062f735-b5eb-4554-91d6-a1fcff9fc5ec_del complete
May 26 05:20:20.822377 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-89462a81-651e-44a8-ad35-ef71320832b7 req-4b807d04-1564-4f9d-af97-48af79fe24ca service nova] Releasing lock "refresh_cache-e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:20.981151 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:20.981372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:20.981493 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] No VIF found with MAC fa:16:3e:d7:38:91, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:20.981876 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Using config drive
May 26 05:20:21.173660 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Took 1.81 seconds to destroy the instance on the hypervisor.
May 26 05:20:21.174135 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:20:21.174365 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:20:21.174519 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:20:21.174804 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:21.231716 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:21.488760 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:21.563359 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-ad161c0d-848a-4ff6-9bac-9343c8d463fc tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.959s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:21.602096 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Creating config drive at /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/disk.config
May 26 05:20:21.611429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpur9ha8e4 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:21.642020 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:21.642396 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] Acquiring lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:21.642683 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:21.642851 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:21.643001 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] No waiting events found dispatching network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:21.643139 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-74913e3d-5e00-49c3-8f7b-e2fbf0513808 req-92316273-7db4-4069-8e1b-f7a5ab2e0bd0 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-unplugged-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:21.645684 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5d220df2-d78f-43ca-ad63-ff2714e0dd3e req-3de05a75-0a57-4ade-93e1-0bccdf3821c7 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Received event network-vif-deleted-206affcc-e4b4-4508-acc1-2a6a3aa3eb5f {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:21.646044 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5d220df2-d78f-43ca-ad63-ff2714e0dd3e req-3de05a75-0a57-4ade-93e1-0bccdf3821c7 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Neutron deleted interface 206affcc-e4b4-4508-acc1-2a6a3aa3eb5f; detaching it from the instance and deleting it from the info cache
May 26 05:20:21.646235 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5d220df2-d78f-43ca-ad63-ff2714e0dd3e req-3de05a75-0a57-4ade-93e1-0bccdf3821c7 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:21.669693 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpur9ha8e4" returned: 0 in 0.061s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:22.058688 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.082424 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.087411 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.088347 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:22.154422 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5d220df2-d78f-43ca-ad63-ff2714e0dd3e req-3de05a75-0a57-4ade-93e1-0bccdf3821c7 service nova] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Detach interface failed, port_id=206affcc-e4b4-4508-acc1-2a6a3aa3eb5f, reason: Instance 5062f735-b5eb-4554-91d6-a1fcff9fc5ec could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:20:22.157654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.230648 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.257442 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e19093d2-13d6-4861-82af-26a0bcb0628b req-7be09c18-ff5b-4105-a7b4-8cc8be0657d4 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:22.257825 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e19093d2-13d6-4861-82af-26a0bcb0628b req-7be09c18-ff5b-4105-a7b4-8cc8be0657d4 service nova] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:22.257972 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e19093d2-13d6-4861-82af-26a0bcb0628b req-7be09c18-ff5b-4105-a7b4-8cc8be0657d4 service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:22.258081 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-e19093d2-13d6-4861-82af-26a0bcb0628b req-7be09c18-ff5b-4105-a7b4-8cc8be0657d4 service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:22.258189 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-e19093d2-13d6-4861-82af-26a0bcb0628b req-7be09c18-ff5b-4105-a7b4-8cc8be0657d4 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Processing event network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:20:22.591427 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Took 1.42 seconds to deallocate network for instance.
May 26 05:20:22.786882 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:20:22.786882 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772822.783799, ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:22.786882 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] VM Started (Lifecycle Event)
May 26 05:20:22.788443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:20:22.791464 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance spawned successfully.
May 26 05:20:22.792709 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:20:22.888464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:22.987207 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:22.989286 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:23.140240 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:20:23.141903 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Deleting volume: e257c900-b4f3-402d-b268-66eebf81eb7a {{(pid=98319) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3450}}
May 26 05:20:23.144969 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.000375206999706279 future=<Future at 0x7d7ac43dc410 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:23.145508 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772808.1444874, 38cb43d7-d96c-48d7-ab0a-1890f44e8956 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:23.145695 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:23.145847 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] VM Stopped (Lifecycle Event)
May 26 05:20:23.147334 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=11.643688453999857 future=<Future at 0x7d7ac41398b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:23.147531 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=11.643459440999777 future=<Future at 0x7d7ac41398b0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:23.289461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:23.291430 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:23.296818 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.297057 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.297362 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.297676 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.298358 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.298358 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:23.494661 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:23.648989 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 38cb43d7-d96c-48d7-ab0a-1890f44e8956] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:23.689558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:23.689558 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:23.797224 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:20:23.797224 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772823.7955656, ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:23.797224 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] VM Paused (Lifecycle Event)
May 26 05:20:23.802031 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Took 8.49 seconds to spawn the instance on the hypervisor.
May 26 05:20:23.802227 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:23.983348 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:23.983348 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:24.298461 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:24.300704 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772824.3004472, ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:24.300901 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] VM Resumed (Lifecycle Event)
May 26 05:20:24.306767 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:24.307288 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:24.307497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:24.307679 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:24.307824 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] No waiting events found dispatching network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:24.308067 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-98b4c16a-9c89-4d3c-b4e1-60b542030b4a req-47221d26-1414-4dd4-a5ec-f81590dbb77e service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received unexpected event network-vif-plugged-9049a94b-cfeb-4292-89a1-3a080cde4359 for instance with vm_state active and task_state None.
May 26 05:20:24.314024 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Took 18.02 seconds to build instance.
May 26 05:20:24.484827 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:24.498776 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:24.803705 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:24.806213 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:24.815827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-b1c1c3ce-ad34-410c-9e2e-1e15f17d6391 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.532s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:24.990991 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.302s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:25.066643 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 5062f735-b5eb-4554-91d6-a1fcff9fc5ec
May 26 05:20:25.198866 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-changed-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:25.199033 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Refreshing instance network info cache due to event network-changed-9049a94b-cfeb-4292-89a1-3a080cde4359. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:25.199228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] Acquiring lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:25.199723 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] Acquired lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:25.199845 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Refreshing network info cache for port 9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:25.314538 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:25.587012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:25.587135 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:25.587355 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attaching volume d43ac437-50f3-41bf-b101-b61e9606bd22 to /dev/vdb
May 26 05:20:25.630160 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:25.642714 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:20:25.664291 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:25.703520 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:25.709752 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:20:25.710127 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:20:25.718048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:20:25.719109 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f', 'fe80::fc16:3eff:fef1:baf1', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fed7:3891'] 
May 26 05:20:25.719306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:20:25.719306 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:20:25.719527 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== get_connector_properties: return (88ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:25.719770 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating existing volume attachment record: 1e9b4341-6080-4aa8-ad0f-dd9c2f4b2b45 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:20:26.003429 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:26.076074 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-4d26b858-ae5d-4b63-ba5c-68220d7338c5 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "5062f735-b5eb-4554-91d6-a1fcff9fc5ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.224s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:26.127855 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updated VIF entry in instance network info cache for port 9049a94b-cfeb-4292-89a1-3a080cde4359. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:20:26.128172 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating instance_info_cache with network_info: [{"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:26.272655 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:20:26.272971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:26.273102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:26.273512 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:26.273697 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:20:26.286485 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:26.287107 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:26.287618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:26.287828 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:26.288295 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:26.288525 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:26.298737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:26.298737 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:26.303210 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:26.303210 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:26.309633 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22] added
May 26 05:20:26.309633 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:26.309633 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:26.309633 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:26.309633 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:26.309633 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:26.309633 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:26.309874 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:26.309997 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0221(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:26.310163 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:26.315086 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22] added
May 26 05:20:26.315086 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:26.315086 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:26.315086 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:26.315086 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:26.315086 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:26.315086 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:26.315511 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:26.315511 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.027(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:26.315732 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:26.630056 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1517a7bc-7812-42ac-930b-28882f3108a6 req-6c23051d-f7a7-40e8-becf-ccd62e0c7fc3 service nova] Releasing lock "refresh_cache-ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:27.310735 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:27.316692 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:27.324411 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:27.324411 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:27.330837 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:27.330837 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.338960 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.347751 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.356388 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.356753 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.363821 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.364089 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:27.396221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.40.100,3260]
May 26 05:20:27.396221 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.40.100,3260] successful.
May 26 05:20:27.396221 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.408453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.424043 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.50.100,3260]
May 26 05:20:27.424043 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.50.100,3260] successful.
May 26 05:20:27.424043 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.427677 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.427994 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:27.428244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.141s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:27.428374 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:27.429626 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('7', '-', '-', 0) found on session 219 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:27.429765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:27.440597 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:27.448109 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:27.462385 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:27.462956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.174s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:27.462956 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:27.463728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] HCTL ('8', '-', '-', 0) found on session 220 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:27.463728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:27.476799 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 220 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:27.889041 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:28.447880 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 219 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:28.448168 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:28.477484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Searching for a device in session 220 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:28.477683 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:29.289895 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:20:30.306447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found WWN 33000000029f10eb6 for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:20:30.307066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.033s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:30.307066 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== connect_volume: return (4034ms) {'type': 'block', 'scsi_wwn': '33000000029f10eb6', 'path': '/dev/dm-0', 'multipath_id': '33000000029f10eb6'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:30.307066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000029f10eb6', 'path': '/dev/dm-0', 'multipath_id': '33000000029f10eb6'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:20:30.311162 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:30.315658 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:30.814370 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to attach volume d43ac437-50f3-41bf-b101-b61e9606bd22 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:20:30.815696 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:   <alias name="ua-d43ac437-50f3-41bf-b101-b61e9606bd22"/>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:   <serial>d43ac437-50f3-41bf-b101-b61e9606bd22</serial>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:30.815696 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:20:31.188116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:31.188116 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:31.691844 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:20:32.235378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:32.235378 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:32.238115 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:20:32.238388 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Claim successful on node np0000001388
May 26 05:20:32.460024 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:32.460176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:32.460291 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:32.460418 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] No VIF found with MAC fa:16:3e:22:4e:d6, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:32.890077 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:33.520982 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:33.521366 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:34.005570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-67e7f487-e081-4f72-a9c0-62a3330ac16c tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.418s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:34.023791 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:34.530282 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:34.530805 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:20:34.791454 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004090490001544822 future=<Future at 0x7d7ac41398b0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:34.791922 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Emitting event <LifecycleEvent: 1779772819.790919, 5062f735-b5eb-4554-91d6-a1fcff9fc5ec => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:34.792082 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:34.795382 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] VM Stopped (Lifecycle Event)
May 26 05:20:35.036023 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:20:35.036459 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:20:35.036459 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:35.036582 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:35.114498 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:20:35.301819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 5062f735-b5eb-4554-91d6-a1fcff9fc5ec] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:35.317612 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:35.527538 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Successfully created port: ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:20:35.543016 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:20:35.969350 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Successfully updated port: ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:20:36.017111 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-changed-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:36.017111 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Refreshing instance network info cache due to event network-changed-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:36.017111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] Acquiring lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:36.017111 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] Acquired lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:36.017111 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Refreshing network info cache for port ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:36.051005 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:20:36.471353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:36.521565 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:36.555496 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Booting with volume 4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa at /dev/vda
May 26 05:20:36.586610 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:36.606477 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:36.620325 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:20:36.644789 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:36.692792 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:20:36.693572 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:20:36.703834 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:20:36.704883 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f', 'fe80::fc16:3eff:fef1:baf1', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fed7:3891'] 
May 26 05:20:36.705018 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:20:36.705121 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:20:36.705382 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (98ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:36.705602 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating existing volume attachment record: 90373fa6-38c2-4bf1-aee8-6f3a266269b3 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:20:36.736234 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:37.239208 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1be1f2ea-368c-44ad-83b7-dc86c56776c0 req-96636b78-97f6-4d86-a929-acf676e4dd45 service nova] Releasing lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:37.239742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:37.239906 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:20:37.596110 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:37.596348 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:37.617763 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:37.618001 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:37.618237 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:37.618522 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:37.818182 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:20:37.891923 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:37.972534 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:38.099737 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating instance_info_cache with network_info: [{"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:38.101063 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Detaching volume d43ac437-50f3-41bf-b101-b61e9606bd22
May 26 05:20:38.140409 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Attempting to driver detach volume d43ac437-50f3-41bf-b101-b61e9606bd22 from mountpoint /dev/vdb
May 26 05:20:38.147698 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-d43ac437-50f3-41bf-b101-b61e9606bd22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:38.149036 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Found disk vdb by alias ua-d43ac437-50f3-41bf-b101-b61e9606bd22 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:38.151456 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Attempting to detach device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:20:38.151456 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <alias name="ua-d43ac437-50f3-41bf-b101-b61e9606bd22"/>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <serial>d43ac437-50f3-41bf-b101-b61e9606bd22</serial>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:38.151456 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:38.157038 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the persistent domain config.
May 26 05:20:38.157212 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] (1/8): Attempting to detach device vdb with device alias ua-d43ac437-50f3-41bf-b101-b61e9606bd22 from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:20:38.157546 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <alias name="ua-d43ac437-50f3-41bf-b101-b61e9606bd22"/>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-0"/>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <serial>d43ac437-50f3-41bf-b101-b61e9606bd22</serial>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:38.157546 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:38.605685 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:38.606154 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance network_info: |[{"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:20:38.617680 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:38.618031 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:38.618031 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:20:38.620342 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:38.653823 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772838.653428, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => ua-d43ac437-50f3-41bf-b101-b61e9606bd22> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:20:38.654624 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-d43ac437-50f3-41bf-b101-b61e9606bd22 for instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:20:38.656726 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully detached device vdb from instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 from the live domain config.
May 26 05:20:38.657675 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:38.657984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:38.658112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:38.658497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:38.658747 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'd43ac437-50f3-41bf-b101-b61e9606bd22', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:38.658888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:38.684580 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [219] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: tcp: [220] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22 (non-flash)
May 26 05:20:38.684996 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', '219'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', '220')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:38.684996 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', '219')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:38.685904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22', '220')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:38.686693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac43f1f80>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:38.686875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:38.687104 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Flush multipath device 33000000029f10eb6 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:38.720593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:38.766816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:38.814842 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:20:38.815858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:20:38.816067 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Creating image(s)
May 26 05:20:38.816368 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:20:38.816518 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Ensure instance console log exists: /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:20:38.816717 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:38.816854 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:38.816971 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:38.817511 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Start _get_guest_xml network_info=[{"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': '90373fa6-38c2-4bf1-aee8-6f3a266269b3', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'c39f8b1b-67dc-442b-b7b0-f6624ad60410', 'attached_at': '', 'detached_at': '', 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'serial': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:20:38.820474 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:20:38.821536 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-507317515', uuid='c39f8b1b-67dc-442b-b7b0-f6624ad60410'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772838.8211694) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:20:38.822628 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:38.822777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:38.823842 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:38.824868 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:20:38.825153 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:20:38.826209 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:20:38.826372 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:20:38.827176 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:20:38.827538 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:20:38.827698 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:20:38.827873 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:20:38.827976 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:20:38.828098 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:20:38.828239 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:20:38.828378 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:20:38.828521 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:20:38.828628 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:20:38.828749 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:20:38.828860 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:20:38.838622 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:38.838813 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:38.839798 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:20:38.840049 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:38.840208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:38.851245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.886604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 219, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.40.100,3260]
May 26 05:20:38.886604 np0000001388 nova-compute[98319]: Logout of [sid: 219, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.40.100,3260] successful.
May 26 05:20:38.886604 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.903890 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.915328 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.947509 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 220, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.50.100,3260]
May 26 05:20:38.947509 np0000001388 nova-compute[98319]: Logout of [sid: 220, target: iqn.2023-03.storpool.com:os--volume-d43ac437-50f3-41bf-b101-b61e9606bd22, portal: 192.168.50.100,3260] successful.
May 26 05:20:38.947509 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.962276 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.962478 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:38.962580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] <== disconnect_volume: return (304ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:38.962687 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:38.964225 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.124s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:38.964399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:20:38.975963 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:38.976647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:38.977157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:38.977373 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:38.977752 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:38.977925 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:38.989218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:38.989218 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:38.994647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:38.994647 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:39.002484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa] added
May 26 05:20:39.002484 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:39.002484 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:39.002484 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:39.002484 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:39.002484 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:39.002484 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:39.002658 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:39.002819 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0254(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:39.002966 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:39.006336 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa] added
May 26 05:20:39.006336 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:39.006336 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:39.006336 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:39.006336 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:39.006336 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:39.006336 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:39.006782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:39.006782 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0287(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:39.006782 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:39.508874 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'flavor' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:40.003393 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:40.008046 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:40.016494 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:40.016494 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:40.025450 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:40.025450 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.032593 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.040529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.049005 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.049233 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.055451 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.055609 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:40.085606 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260]
May 26 05:20:40.085606 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260] successful.
May 26 05:20:40.085606 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.091945 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260]
May 26 05:20:40.091945 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260] successful.
May 26 05:20:40.091945 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.099559 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.104069 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.114484 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.114702 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:40.114875 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.138s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:40.114936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:40.115871 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('7', '-', '-', 0) found on session 221 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:40.116009 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.121033 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:40.121313 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:40.121474 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.144s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:40.121627 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:40.122375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('8', '-', '-', 0) found on session 222 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:40.122486 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:40.129352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 221 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:40.129555 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:40.137321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 222 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:40.137321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:40.318827 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:40.501251 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:40.501689 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:40.515675 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-11d13fb9-83da-4d7c-ad45-b3b7838edf1f tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.919s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:40.618495 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:40.977816 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:20:41.122507 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:41.122909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:41.122909 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:41.122909 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:20:41.992687 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 33000000096ef513d for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:20:41.992913 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.029s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:41.993055 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3152ms) {'type': 'block', 'scsi_wwn': '33000000096ef513d', 'path': '/dev/dm-0', 'multipath_id': '33000000096ef513d'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:41.993170 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000096ef513d', 'path': '/dev/dm-0', 'multipath_id': '33000000096ef513d'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:20:42.146758 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-1 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:20:42.148118 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:20:42.149525 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:42.235157 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.085s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:42.235703 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:42.319519 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:42.323212 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:42.405018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:42.405499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:42.486415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:42.490408 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-4 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:20:42.492064 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:20:42.493042 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:42.506760 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-507317515',display_name='tempest-TestVolumeBootPattern-server-507317515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-507317515',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-bypry08b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:36Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=c39f8b1b-67dc-442b-b7b0-f6624ad60410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:20:42.507295 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:42.508487 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:42.509706 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid c39f8b1b-67dc-442b-b7b0-f6624ad60410 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:42.537464 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:42.537782 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=12554MB free_disk=72.5489273071289GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:20:42.537926 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:42.538123 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:42.833564 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:42.834304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:42.896905 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.013978 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] End _get_guest_xml xml=<domain type="qemu">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <uuid>c39f8b1b-67dc-442b-b7b0-f6624ad60410</uuid>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <name>instance-0000004f</name>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-507317515</nova:name>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:20:38</nova:creationTime>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         <nova:port uuid="ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <system>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="serial">c39f8b1b-67dc-442b-b7b0-f6624ad60410</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="uuid">c39f8b1b-67dc-442b-b7b0-f6624ad60410</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </system>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <os>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </os>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <features>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </features>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   <devices>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/disk.config"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <alias name="ua-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <serial>4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa</serial>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </disk>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:1e:c0:8e"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <target dev="tapebd1e5aa-8d"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </interface>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/console.log" append="off"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </serial>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <video>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </video>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </rng>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:   </devices>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]: </domain>
May 26 05:20:43.013978 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Preparing to wait for external event network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-507317515',display_name='tempest-TestVolumeBootPattern-server-507317515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-507317515',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-bypry08b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:20:36Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=c39f8b1b-67dc-442b-b7b0-f6624ad60410,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:20:43.017415 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.017847 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:43.017847 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:20:43.018516 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.018670 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1997e87-8880-54e3-9097-2c2046d63d6a', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:43.019435 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.020010 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:43.020261 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.022686 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.022816 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd1e5aa-8d, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:43.023157 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebd1e5aa-8d, col_values=(('qos', UUID('8b8e47eb-f7f8-4718-843a-67ac00dd053e')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:43.023330 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebd1e5aa-8d, col_values=(('external_ids', {'iface-id': 'ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:c0:8e', 'vm-uuid': 'c39f8b1b-67dc-442b-b7b0-f6624ad60410'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:43.024254 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.025410 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:43.029769 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:43.030873 np0000001388 nova-compute[98319]: INFO os_vif [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d')
May 26 05:20:43.337965 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:43.590154 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 17158763-773e-42db-aaf8-0a57badcf9c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590277 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590391 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c111c430-52e7-4230-a277-1b251644c913 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590474 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590558 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590639 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance c39f8b1b-67dc-442b-b7b0-f6624ad60410 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:20:43.590806 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:20:43.590912 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=1664MB phys_disk=95GB used_disk=2GB total_vcpus=12 used_vcpus=6 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:20:42 up 52 min,  2 users,  load average: 2.73, 3.88, 4.25\n', 'num_instances': '6', 'num_vm_active': '5', 'num_task_None': '5', 'num_os_type_None': '6', 'num_proj_a6588fb6c3894fadbc7f9ded9103be11': '3', 'io_workload': '1', 'num_proj_da91b73f7ccf4fb3b02ddd9898a2c50e': '1', 'num_proj_56542810ab5d4dd9b443231e8931b871': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:20:43.876582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:43.876857 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:44.344069 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 1.510s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:44.379557 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:44.544741 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:44.544862 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:44.544966 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:1e:c0:8e, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:44.545318 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Using config drive
May 26 05:20:44.885958 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:20:44.886903 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.349s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:44.887398 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:45.050281 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:45.155533 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Creating config drive at /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/disk.config
May 26 05:20:45.158419 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3yv1bgm8 {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:45.210500 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp3yv1bgm8" returned: 0 in 0.052s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:20:45.389689 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.73 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:45.398122 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:45.398417 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:45.398666 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Attaching volume a7622c07-b16a-4852-aa27-37dc28152a62 to /dev/vdb
May 26 05:20:45.431437 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:45.441746 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:20:45.460068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:20:45.501240 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:20:45.501586 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:20:45.510244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:20:45.511467 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fec1:3009', 'fe80::94ca:83ff:fe39:c639', 'fe80::fc16:3eff:fe22:4ed6', 'fe80::44da:efff:feaa:1c93', 'fe80::fc16:3eff:feb6:9f7f', 'fe80::fc16:3eff:fef1:baf1', 'fe80::9c4e:dfff:fe55:abca', 'fe80::fc16:3eff:fed7:3891'] 
May 26 05:20:45.511591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:20:45.511693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:20:45.511920 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:45.512150 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating existing volume attachment record: 96b04a82-ab87-4d11-ad21-3cc351bc6231 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:20:45.600344 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.618876 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.620341 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.705233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.764546 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-457efa52-e65f-4179-89fc-388ab35fde13 req-837b9e92-855b-4f53-95c5-49b5ddce59f4 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:45.765121 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-457efa52-e65f-4179-89fc-388ab35fde13 req-837b9e92-855b-4f53-95c5-49b5ddce59f4 service nova] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:45.765343 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-457efa52-e65f-4179-89fc-388ab35fde13 req-837b9e92-855b-4f53-95c5-49b5ddce59f4 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:45.765462 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-457efa52-e65f-4179-89fc-388ab35fde13 req-837b9e92-855b-4f53-95c5-49b5ddce59f4 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:45.765570 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-457efa52-e65f-4179-89fc-388ab35fde13 req-837b9e92-855b-4f53-95c5-49b5ddce59f4 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Processing event network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:20:45.936313 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.937809 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.939662 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.940939 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:45.955744 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:46.055476 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:20:46.055832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:46.055984 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:46.056334 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:46.056527 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:20:46.067452 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:46.067885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:46.068346 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:46.068592 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:46.068919 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:46.069081 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:46.079279 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:46.079279 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:46.084506 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:20:46.084506 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:46.090221 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62] added
May 26 05:20:46.090221 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:46.090221 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:46.090221 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:46.090221 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:46.090221 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:46.090221 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:46.090410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:46.090554 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0223(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:46.090688 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:46.097057 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62] added
May 26 05:20:46.097057 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:20:46.097057 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:46.097057 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:46.097057 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:20:46.097057 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:20:46.097057 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:46.097217 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:20:46.097335 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0282(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:20:46.097488 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:20:46.263595 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772846.2631872, c39f8b1b-67dc-442b-b7b0-f6624ad60410 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:46.264118 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:20:46.264383 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] VM Started (Lifecycle Event)
May 26 05:20:46.266216 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:20:46.269004 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance spawned successfully.
May 26 05:20:46.269329 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:20:46.767889 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:46.769918 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:46.778183 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:46.778296 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:46.778751 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:46.779097 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:46.779367 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:46.780306 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:20:47.091120 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:20:47.097987 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:47.106000 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:47.106000 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:20:47.112122 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:20:47.112122 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.118505 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.125017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.136272 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.136538 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.143063 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.143244 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:47.179690 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.40.100,3260]
May 26 05:20:47.179690 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.40.100,3260] successful.
May 26 05:20:47.179690 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.191468 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.192118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.50.100,3260]
May 26 05:20:47.192118 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.50.100,3260] successful.
May 26 05:20:47.192118 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.208689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.209088 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.209358 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:47.209547 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.142s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:47.209609 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:47.210659 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('13', '-', '-', 0) found on session 223 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:47.210788 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:47.225616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 223 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:47.225616 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.226314 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:47.226530 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:47.226823 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.158s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:47.226990 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:20:47.228432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] HCTL ('14', '-', '-', 0) found on session 224 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:20:47.228432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:20:47.243106 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Searching for a device in session 224 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:20:47.243271 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:20:47.275000 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:20:47.275222 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772847.2750688, c39f8b1b-67dc-442b-b7b0-f6624ad60410 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:47.275325 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] VM Paused (Lifecycle Event)
May 26 05:20:47.286448 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Took 8.47 seconds to spawn the instance on the hypervisor.
May 26 05:20:47.286773 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:47.777959 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:47.780100 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772847.7798934, c39f8b1b-67dc-442b-b7b0-f6624ad60410 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:20:47.780254 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] VM Resumed (Lifecycle Event)
May 26 05:20:47.794866 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Took 15.60 seconds to build instance.
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] No waiting events found dispatching network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:47.830936 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-ae7ffaaa-a88e-40bc-95c8-f1659a6c3f38 req-c3c3f479-f1e3-422e-b034-955e2a0a8d8a service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received unexpected event network-vif-plugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 for instance with vm_state active and task_state None.
May 26 05:20:47.898836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:48.024350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:48.069126 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}}
May 26 05:20:48.282495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:20:48.284234 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:20:48.297660 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.110s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:48.593742 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:48.594499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:48.594499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:48.594499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:48.594499 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:48.596187 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Terminating instance
May 26 05:20:49.085755 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found WWN 330000000f34423e0 for multipath device dm-7 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:20:49.086102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.030s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:49.086314 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== connect_volume: return (3030ms) {'type': 'block', 'scsi_wwn': '330000000f34423e0', 'path': '/dev/dm-7', 'multipath_id': '330000000f34423e0'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:49.086314 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f34423e0', 'path': '/dev/dm-7', 'multipath_id': '330000000f34423e0'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:20:49.091366 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:49.099050 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:20:49.114984 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.116652 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.134017 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.153554 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.272902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:49.273090 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:49.273653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:49.273805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:49.273944 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] No waiting events found dispatching network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:49.274098 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4843f84a-59dd-47b4-881e-276f403efd0e req-73c064ed-f415-44a8-97b5-90f589cd5132 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:49.335965 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.419027 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99971400100003 future=<Future at 0x7d7aa443fb90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:49.419446 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999275147999924 future=<Future at 0x7d7aa443fb90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:49.419566 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99913318400013 future=<Future at 0x7d7aa443fb90 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:49.421344 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Instance destroyed successfully.
May 26 05:20:49.421735 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lazy-loading 'resources' on Instance uuid faa9b6e7-20f7-4970-bc06-b3f1275c4a94 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:49.594255 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Attempting to attach volume a7622c07-b16a-4852-aa27-37dc28152a62 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98319) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2330}}
May 26 05:20:49.595530 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] attach device xml: <disk type="block" device="disk">
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <alias name="ua-a7622c07-b16a-4852-aa27-37dc28152a62"/>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <serial>a7622c07-b16a-4852-aa27-37dc28152a62</serial>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:49.595530 np0000001388 nova-compute[98319]:  {{(pid=98319) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}}
May 26 05:20:49.884578 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-changed-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:49.884721 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Refreshing instance network info cache due to event network-changed-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:20:49.884897 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] Acquiring lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:20:49.885024 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] Acquired lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:20:49.885177 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Refreshing network info cache for port ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:20:49.923749 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:18:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-414651452',display_name='tempest-SnapshotDataIntegrityTests-server-414651452',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-snapshotdataintegritytests-server-414651452',id=74,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpbtyY6mYlvk7QDxo+kEIuHITE9q3rYsroTo7LXwwksABRJMWNQyzRWkFphbOCo4xNt1nLyB/Rbw+sr3O6WalsZ48Lc3sm2gynbvRL0AM/xx+X7RLyj9pKBxtzKOjyoJA==',key_name='tempest-keypair-890579420',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:18:44Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da91b73f7ccf4fb3b02ddd9898a2c50e',ramdisk_id='',reservation_id='r-n0yok81k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-2135014341',owner_user_name='tempest-SnapshotDataIntegrityTests-2135014341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:18:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6b4b1a0cda91478583b3851a87c2d4e6',uuid=faa9b6e7-20f7-4970-bc06-b3f1275c4a94,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:20:49.924034 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converting VIF {"id": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "address": "fa:16:3e:22:4e:d6", "network": {"id": "c28563f8-3891-4af2-8b6a-0e8dc1276882", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1767701940-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "da91b73f7ccf4fb3b02ddd9898a2c50e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7259f6e-34", "ovs_interfaceid": "f7259f6e-344d-4a2f-9fb6-e873d9988f23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:49.924463 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:49.924668 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:20:49.926033 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.926228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7259f6e-34, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:49.927128 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.928406 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:49.928763 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.928866 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5c9443ac-56c9-49a7-b0e7-2fc0cee587b6) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:49.929250 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.929658 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:49.929830 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:49.931286 np0000001388 nova-compute[98319]: INFO os_vif [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:4e:d6,bridge_name='br-int',has_traffic_filtering=True,id=f7259f6e-344d-4a2f-9fb6-e873d9988f23,network=Network(c28563f8-3891-4af2-8b6a-0e8dc1276882),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7259f6e-34')
May 26 05:20:49.931525 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Deleting instance files /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94_del
May 26 05:20:49.932211 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Deletion of /opt/stack/data/nova/instances/faa9b6e7-20f7-4970-bc06-b3f1275c4a94_del complete
May 26 05:20:50.120251 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:50.120711 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:50.120711 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances with incomplete migration  {{(pid=98319) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12121}}
May 26 05:20:50.387122 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:50.437960 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Took 1.34 seconds to destroy the instance on the hypervisor.
May 26 05:20:50.438437 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:20:50.438576 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:20:50.438649 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:20:50.438828 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:50.502163 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:50.622970 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:50.702086 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:50.839938 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updated VIF entry in instance network info cache for port ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:20:50.840296 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating instance_info_cache with network_info: [{"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:51.234008 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:51.234452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:51.234452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:20:51.234452 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] No VIF found with MAC fa:16:3e:f1:ba:f1, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:20:51.331155 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:51.331431 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] Acquiring lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:51.334224 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:51.334383 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:51.334495 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] No waiting events found dispatching network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:51.334598 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-29e745f7-20f4-4dd5-8ea4-a556dc49f3c8 req-fa32a58f-7a32-42aa-8f15-5f5649f7c9cf service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-unplugged-f7259f6e-344d-4a2f-9fb6-e873d9988f23 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:51.342570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4eb23e05-bee4-4261-a38f-53c6e12670d2 req-7275de7d-7947-44f2-bc64-f6b8949ab860 service nova] Releasing lock "refresh_cache-c39f8b1b-67dc-442b-b7b0-f6624ad60410" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:20:51.419748 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:20:51.921637 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Took 1.48 seconds to deallocate network for instance.
May 26 05:20:51.945416 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-96e12685-7451-46b4-994a-7cb81ff4aa86 req-5b77997d-f595-4675-834d-42c0bd91b8c4 service nova] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Received event network-vif-deleted-f7259f6e-344d-4a2f-9fb6-e873d9988f23 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:52.427082 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:52.427647 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:52.723862 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:20:52.724976 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:20:52.780091 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-70ef3ff1-145f-4249-b923-79cf21b1d8a1 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.382s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:52.900561 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:53.226711 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:20:53.322730 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:53.322896 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:53.734143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.307s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:53.790629 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Deleted allocations for instance faa9b6e7-20f7-4970-bc06-b3f1275c4a94
May 26 05:20:53.825056 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Detaching volume a7622c07-b16a-4852-aa27-37dc28152a62
May 26 05:20:53.871439 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Attempting to driver detach volume a7622c07-b16a-4852-aa27-37dc28152a62 from mountpoint /dev/vdb
May 26 05:20:53.875119 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-a7622c07-b16a-4852-aa27-37dc28152a62 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:53.876173 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Found disk vdb by alias ua-a7622c07-b16a-4852-aa27-37dc28152a62 {{(pid=98319) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2892}}
May 26 05:20:53.876345 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Attempting to detach device vdb from instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 from the persistent domain config. {{(pid=98319) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2642}}
May 26 05:20:53.876590 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <alias name="ua-a7622c07-b16a-4852-aa27-37dc28152a62"/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <serial>a7622c07-b16a-4852-aa27-37dc28152a62</serial>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:53.876590 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:53.883099 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 from the persistent domain config.
May 26 05:20:53.883292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] (1/8): Attempting to detach device vdb with device alias ua-a7622c07-b16a-4852-aa27-37dc28152a62 from instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 from the live domain config. {{(pid=98319) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2676}}
May 26 05:20:53.883665 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.guest [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] detach device xml: <disk type="block" device="disk">
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <alias name="ua-a7622c07-b16a-4852-aa27-37dc28152a62"/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <source dev="/dev/dm-7"/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <target dev="vdb" bus="virtio"/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <serial>a7622c07-b16a-4852-aa27-37dc28152a62</serial>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <shareable/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]: </disk>
May 26 05:20:53.883665 np0000001388 nova-compute[98319]:  {{(pid=98319) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}}
May 26 05:20:54.352471 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Received event <DeviceRemovedEvent: 1779772854.3520648, e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 => ua-a7622c07-b16a-4852-aa27-37dc28152a62> from libvirt while the driver is waiting for it; dispatched. {{(pid=98319) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2529}}
May 26 05:20:54.354785 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-a7622c07-b16a-4852-aa27-37dc28152a62 for instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2756}}
May 26 05:20:54.357252 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully detached device vdb from instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 from the live domain config.
May 26 05:20:54.382898 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:20:54.383290 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': False}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:20:54.383489 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:20:54.383928 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:20:54.384352 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'a7622c07-b16a-4852-aa27-37dc28152a62', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:20:54.384543 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:54.416316 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [223] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: tcp: [224] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62 (non-flash)
May 26 05:20:54.416782 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '222'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', '223'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', '224')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:20:54.416782 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', '223')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:54.417589 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62', '224')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:20:54.418354 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa458a0c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'): ({'sdh'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'): ({'sdi'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:20:54.418522 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Removing multipathed devices sdi, sdh {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:20:54.418738 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Flush multipath device 330000000f34423e0 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:20:54.457754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:54.495545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:20:54.536456 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:20:54.536590 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] SCSI volumes sdi, sdh have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:20:54.537708 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Checking to see if device paths {'sdi', 'sdh'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:20:54.551647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Device paths {'sdi', 'sdh'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:20:54.551831 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:20:54.565270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.601450 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 223, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.40.100,3260]
May 26 05:20:54.601450 np0000001388 nova-compute[98319]: Logout of [sid: 223, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.40.100,3260] successful.
May 26 05:20:54.601450 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.619936 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.630132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.662151 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 224, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.50.100,3260]
May 26 05:20:54.662151 np0000001388 nova-compute[98319]: Logout of [sid: 224, target: iqn.2023-03.storpool.com:os--volume-a7622c07-b16a-4852-aa27-37dc28152a62, portal: 192.168.50.100,3260] successful.
May 26 05:20:54.662151 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.679886 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:20:54.680112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:20:54.680273 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] <== disconnect_volume: return (296ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:20:54.680448 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:20:54.797988 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-cd927ff4-cf72-4d7a-a7df-b8e76fbd0aee tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Lock "faa9b6e7-20f7-4970-bc06-b3f1275c4a94" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.204s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:54.929418 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:55.236077 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'flavor' on Instance uuid e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:56.241707 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-36db6ecf-9ee3-4b8c-aa06-ff5be971d5d7 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.919s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:56.988729 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:57.121172 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:20:57.121346 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Cleaning up deleted instances {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12083}}
May 26 05:20:57.624763 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] There are 0 instances to clean {{(pid=98319) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12092}}
May 26 05:20:57.625140 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 40.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:20:57.724008 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:57.724216 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:57.724406 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:57.724570 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:57.724713 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:57.726916 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Terminating instance
May 26 05:20:57.901997 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:58.230771 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:20:58.252133 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:58.254181 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:58.272131 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:58.290837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:58.530142 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:20:58.530142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:20:58.530142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:20:58.530142 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:20:58.531041 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] No waiting events found dispatching network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:20:58.531041 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-109d9ad5-ac02-4b27-b662-dbaade8f1c53 req-bcb4c61d-ecd3-42ff-a0d6-7163acfb535b service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:20:58.559672 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999692300000333 future=<Future at 0x7d7aa44ace00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:20:58.561791 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Instance destroyed successfully.
May 26 05:20:58.562371 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lazy-loading 'resources' on Instance uuid e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:20:59.066419 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-VolumeMultiattachTests-server-597614084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-volumemultiattachtests-server-597614084',id=77,image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowCextoahFsErLVOKsExE8w0X1lULixXw1KtYPfYkUnEEHi0svpgjQd/fWng1FLMU7mtmCzoKmhcMshx9F4O1t5QomUEt9s8JLWQI68B5B02W/F17iUkSoJxoj3d3GaA==',key_name='tempest-keypair-1764222304',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:20:17Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56542810ab5d4dd9b443231e8931b871',ramdisk_id='',reservation_id='r-mwfys1mv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='eb1b37ef-ecaa-41a5-b927-a074eae64cb1',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumeMultiattachTests-2100574999',owner_user_name='tempest-VolumeMultiattachTests-2100574999-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:20:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3ee150517d34539b56afa2c9433e087',uuid=e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:20:59.066419 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converting VIF {"id": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "address": "fa:16:3e:f1:ba:f1", "network": {"id": "0d77d3fd-cc41-404d-9820-82eac91d7779", "bridge": "br-int", "label": "tempest-VolumeMultiattachTests-126885995-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "56542810ab5d4dd9b443231e8931b871", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4dbd9514-a7", "ovs_interfaceid": "4dbd9514-a7ee-4751-af44-6cde5e09729c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:20:59.066419 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:20:59.066419 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:20:59.067294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.067294 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4dbd9514-a7, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:59.068125 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.069161 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:59.069402 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.070007 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.070112 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b35fa498-a246-4cf9-9ad4-5383c34405a9) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:20:59.070671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.071283 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:20:59.071384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.073027 np0000001388 nova-compute[98319]: INFO os_vif [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:ba:f1,bridge_name='br-int',has_traffic_filtering=True,id=4dbd9514-a7ee-4751-af44-6cde5e09729c,network=Network(0d77d3fd-cc41-404d-9820-82eac91d7779),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4dbd9514-a7')
May 26 05:20:59.076377 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Deleting instance files /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1_del
May 26 05:20:59.076377 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Deletion of /opt/stack/data/nova/instances/e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1_del complete
May 26 05:20:59.323912 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:20:59.580515 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Took 1.35 seconds to destroy the instance on the hypervisor.
May 26 05:20:59.581713 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:20:59.582546 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:20:59.582616 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:20:59.582863 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:20:59.653390 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:00.142708 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5476d248-b5b1-4b4c-86b9-a151255d84ad req-0c305285-28a7-4815-ab32-282d87217de4 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-deleted-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:00.143161 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5476d248-b5b1-4b4c-86b9-a151255d84ad req-0c305285-28a7-4815-ab32-282d87217de4 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Neutron deleted interface 4dbd9514-a7ee-4751-af44-6cde5e09729c; detaching it from the instance and deleting it from the info cache
May 26 05:21:00.143366 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5476d248-b5b1-4b4c-86b9-a151255d84ad req-0c305285-28a7-4815-ab32-282d87217de4 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:00.593378 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:00.614257 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:00.614468 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] Acquiring lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:00.614791 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:00.614958 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:00.615122 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] No waiting events found dispatching network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:00.615295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-00142035-a493-4054-a18a-a908db7cb08b req-94a92901-e989-48bf-a116-63e7d6678a34 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Received event network-vif-unplugged-4dbd9514-a7ee-4751-af44-6cde5e09729c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:00.647127 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5476d248-b5b1-4b4c-86b9-a151255d84ad req-0c305285-28a7-4815-ab32-282d87217de4 service nova] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Detach interface failed, port_id=4dbd9514-a7ee-4751-af44-6cde5e09729c, reason: Instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:21:01.094518 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Took 1.51 seconds to deallocate network for instance.
May 26 05:21:01.600922 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:01.601328 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:01.811893 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Refreshing inventories for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}}
May 26 05:21:01.852338 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Updating ProviderTree inventory for provider 532664ff-66ca-4f17-bdd2-18f1300079ea from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}}
May 26 05:21:01.852517 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Updating inventory in ProviderTree for provider 532664ff-66ca-4f17-bdd2-18f1300079ea with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
May 26 05:21:01.891028 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Refreshing aggregate associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, aggregates: None {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}}
May 26 05:21:01.938220 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Refreshing trait associations for resource provider 532664ff-66ca-4f17-bdd2-18f1300079ea, traits: COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_STORAGE_BUS_SATA,COMPUTE_ARCH_MIPSEL,COMPUTE_ARCH_PPC64LE,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE42,COMPUTE_ARCH_AARCH64,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_TRUSTED_CERTS,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE2,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_SOUND_MODEL_AC97,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_AKI,HW_CPU_X86_MMX,COMPUTE_ARCH_X86_64,HW_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ACCELERATORS,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_ARCH_RISCV64,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,COMPUTE_SOUND_MODEL_SB16,COMPUTE_ARCH_S390X,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSSE3,COMPUTE_SOUND_MODEL_USB,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_NE2K_PCI,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_VMXNET3 {{(pid=98319) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}}
May 26 05:21:02.078811 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:02.079049 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:02.079295 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:02.079465 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:02.079612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:02.083239 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Terminating instance
May 26 05:21:02.178582 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:02.178753 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:02.587010 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:21:02.600346 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.602484 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.621164 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.684226 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:02.734530 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:02.734992 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:02.735143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:02.735319 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:02.735446 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] No waiting events found dispatching network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:02.735556 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1b1a6c3b-964b-406e-ae9f-4692b33153ab req-a955cc42-538c-4d04-92ab-967dd9f004a0 service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:02.766589 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.771981 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.902435 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999711115000082 future=<Future at 0x7d7aa4378ad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:02.903092 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:02.904919 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Instance destroyed successfully.
May 26 05:21:02.905279 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'resources' on Instance uuid ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:21:03.187353 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.586s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:03.234633 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Deleted allocations for instance e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1
May 26 05:21:03.407502 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:20:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1110005998',display_name='tempest-TestVolumeBootPatternV346-server-1110005998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1110005998',id=78,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlwAbEzwnW/GRf3wacIHBNzPHPdPLCo4joktAju1cBrlrk9keanOFJcvjEKLKt3RHtsfwMSIVHheRF97GlVdFz/bXkvz+zLiXgqq3iAx4iOes8LkpRMIJ8w1tGMPae7tw==',key_name='tempest-keypair-2050122101',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:20:23Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-730pai4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:20:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:21:03.407749 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "9049a94b-cfeb-4292-89a1-3a080cde4359", "address": "fa:16:3e:d7:38:91", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9049a94b-cf", "ovs_interfaceid": "9049a94b-cfeb-4292-89a1-3a080cde4359", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:03.408192 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:03.408427 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:21:03.409353 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:03.409512 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9049a94b-cf, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:03.424519 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:03.425516 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:03.425999 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:03.426137 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff63ef97-dd44-4784-9df7-a377a378efe8) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:03.426570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:03.427034 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:03.427265 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:03.428844 np0000001388 nova-compute[98319]: INFO os_vif [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d7:38:91,bridge_name='br-int',has_traffic_filtering=True,id=9049a94b-cfeb-4292-89a1-3a080cde4359,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9049a94b-cf')
May 26 05:21:03.430093 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:21:03.430387 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:03.430492 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:03.430779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:03.431030 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-4'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:21:03.431133 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:03.456780 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [217] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [218] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259 (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:03.457115 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:03.457115 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:21:03.457367 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '217')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:03.458098 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259', '218')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:03.458857 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c23e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'): ({'sdg'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:21:03.459076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Removing multipathed devices sdg, sdf {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:21:03.459326 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flush multipath device 3300000004bc32f6d {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:21:03.509315 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:03.550719 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:03.606531 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:21:03.606885 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] SCSI volumes sdg, sdf have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:21:03.607751 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if device paths {'sdg', 'sdf'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:21:03.619346 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Device paths {'sdg', 'sdf'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:21:03.619601 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:21:03.631399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.666150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 217, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.40.100,3260]
May 26 05:21:03.666150 np0000001388 nova-compute[98319]: Logout of [sid: 217, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.40.100,3260] successful.
May 26 05:21:03.666150 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.682095 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.692653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.721114 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 218, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.50.100,3260]
May 26 05:21:03.721114 np0000001388 nova-compute[98319]: Logout of [sid: 218, target: iqn.2023-03.storpool.com:os--volume-bde5e33a-e9ba-41fc-b1b7-cfe06d539259, portal: 192.168.50.100,3260] successful.
May 26 05:21:03.721114 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.735989 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:03.736272 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:03.736397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== disconnect_volume: return (305ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:03.736509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:21:03.736744 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Deleting instance files /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a_del
May 26 05:21:03.737171 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Deletion of /opt/stack/data/nova/instances/ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a_del complete
May 26 05:21:04.244257 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a2888fe6-2de2-4866-8e0d-c7100ce09c55 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Lock "e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.520s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:04.245728 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Took 1.66 seconds to destroy the instance on the hypervisor.
May 26 05:21:04.246365 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:21:04.247047 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:21:04.247047 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:21:04.247047 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:04.339705 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:04.419151 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004142930001762579 future=<Future at 0x7d7aa443fb90 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:04.420236 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772849.4186263, faa9b6e7-20f7-4970-bc06-b3f1275c4a94 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:04.420411 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:04.420611 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] VM Stopped (Lifecycle Event)
May 26 05:21:04.421565 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.137768969000263 future=<Future at 0x7d7aa44ace00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:04.421723 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.13759181100022 future=<Future at 0x7d7aa44ace00 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:04.809553 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:04.810005 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] Acquiring lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:04.810165 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:04.810352 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:04.810539 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] No waiting events found dispatching network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:04.810624 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-unplugged-9049a94b-cfeb-4292-89a1-3a080cde4359 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:04.811006 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Received event network-vif-deleted-9049a94b-cfeb-4292-89a1-3a080cde4359 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:04.811006 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Neutron deleted interface 9049a94b-cfeb-4292-89a1-3a080cde4359; detaching it from the instance and deleting it from the info cache
May 26 05:21:04.811006 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:04.922859 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: faa9b6e7-20f7-4970-bc06-b3f1275c4a94] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:05.192424 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:05.315085 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-53e5b3be-c8d2-445d-a265-824d863c3d33 req-82f86ead-7f15-4965-bcd4-03ff3eaded0d service nova] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Detach interface failed, port_id=9049a94b-cfeb-4292-89a1-3a080cde4359, reason: Instance ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:21:05.694515 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Took 1.45 seconds to deallocate network for instance.
May 26 05:21:06.083747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:06.237752 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:21:06.743901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:06.743901 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:06.947238 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:06.947238 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:07.448950 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:07.554290 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:07.904671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:07.956606 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.213s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:08.005850 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Deleted allocations for instance ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a
May 26 05:21:08.427492 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:09.019805 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-134a955a-492d-4ca1-b709-555fab1daf04 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.941s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:12.833739 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:12.834231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:12.834231 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:12.834346 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:12.834461 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:12.836563 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Terminating instance
May 26 05:21:12.917235 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.343494 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:21:13.362247 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.365632 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.381574 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.428725 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.514772 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:13.515119 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:13.515308 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:13.515535 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:13.515722 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] No waiting events found dispatching network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:13.516244 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-2b2e84c8-fb4e-4599-a5af-ab1d5e2d9cda req-a666b33b-174d-439f-9a17-546c45d8d6b7 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:13.558136 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.559942 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0005957529997431266 future=<Future at 0x7d7aa44ace00 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:13.560037 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:13.560143 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.341979496000022 future=<Future at 0x7d7aa4378ad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:13.560337 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=4.341885041999831 future=<Future at 0x7d7aa4378ad0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:13.561347 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772858.559264, e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:13.562490 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] VM Stopped (Lifecycle Event)
May 26 05:21:13.563626 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:13.678866 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99970413200026 future=<Future at 0x7d7aa45cb290 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:13.681771 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c111c430-52e7-4230-a277-1b251644c913] Instance destroyed successfully.
May 26 05:21:13.683614 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'resources' on Instance uuid c111c430-52e7-4230-a277-1b251644c913 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:21:14.066949 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6aa50e4a-4dce-4ad9-a3d8-fc42cdea7247 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: e2c16cf7-2a2f-4c8d-abdf-ae5d5978c5e1] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:14.187757 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:19:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1810229422',display_name='tempest-TestVolumeBootPatternV346-server-1810229422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1810229422',id=75,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLIZZMMU3gI/Jws+Hmb9hfg0jkyMFf5ZsZi+bUDcDJW4Zl8Xgg1lAB4JAaPyy/gPrC1tu0sDx8f5JTu+e08aAGgQcw08cYmlDGuMuJmXYaGFU3aXEfSsf8ZweFXjJeWdYw==',key_name='tempest-keypair-27613430',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:19:21Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-kc207koz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:19:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=c111c430-52e7-4230-a277-1b251644c913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:21:14.187950 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "address": "fa:16:3e:b6:9f:7f", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapcf5ef042-fb", "ovs_interfaceid": "cf5ef042-fb19-4415-ab20-d7a7335e180c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:14.188377 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:14.188552 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:21:14.189528 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.189756 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcf5ef042-fb, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:14.199812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.199812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:14.199812 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.200293 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.201437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=43403f37-aae3-4d77-a906-24c020db3b48) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:14.201437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.201437 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:14.202454 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:14.204147 np0000001388 nova-compute[98319]: INFO os_vif [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:9f:7f,bridge_name='br-int',has_traffic_filtering=True,id=cf5ef042-fb19-4415-ab20-d7a7335e180c,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcf5ef042-fb')
May 26 05:21:14.205509 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:21:14.205822 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:14.206017 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:14.206435 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:14.206679 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'aef574e6-6b0f-46df-9c06-924812c1b4f3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:21:14.206791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:14.232453 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: tcp: [207] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: tcp: [208] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3 (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:14.232773 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:14.232773 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:21:14.233024 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '207')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:14.233610 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3', '208')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:14.234270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac4448360>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'): ({'sdm'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:21:14.234428 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Removing multipathed devices sdl, sdm {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:21:14.234604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flush multipath device 330000000f01d5964 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:21:14.285482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:14.336656 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:14.378477 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:21:14.378693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] SCSI volumes sdl, sdm have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:21:14.379545 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if device paths {'sdl', 'sdm'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:21:14.389128 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Device paths {'sdl', 'sdm'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:21:14.389605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:21:14.400252 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.430112 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 207, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.40.100,3260]
May 26 05:21:14.430112 np0000001388 nova-compute[98319]: Logout of [sid: 207, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.40.100,3260] successful.
May 26 05:21:14.430112 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.443783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.453640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.486872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 208, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.50.100,3260]
May 26 05:21:14.486872 np0000001388 nova-compute[98319]: Logout of [sid: 208, target: iqn.2023-03.storpool.com:os--volume-aef574e6-6b0f-46df-9c06-924812c1b4f3, portal: 192.168.50.100,3260] successful.
May 26 05:21:14.486872 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.501529 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:14.501669 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:14.501785 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== disconnect_volume: return (296ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:14.501923 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:21:14.502142 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Deleting instance files /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913_del
May 26 05:21:14.502593 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Deletion of /opt/stack/data/nova/instances/c111c430-52e7-4230-a277-1b251644c913_del complete
May 26 05:21:15.008097 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Took 1.66 seconds to destroy the instance on the hypervisor.
May 26 05:21:15.009327 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:21:15.009497 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c111c430-52e7-4230-a277-1b251644c913] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:21:15.009575 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c111c430-52e7-4230-a277-1b251644c913] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:21:15.009753 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:15.061823 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:15.566272 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:15.566589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] Acquiring lock "c111c430-52e7-4230-a277-1b251644c913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:15.566589 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:15.566689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] Lock "c111c430-52e7-4230-a277-1b251644c913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:15.566803 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] No waiting events found dispatching network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:15.566902 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-unplugged-cf5ef042-fb19-4415-ab20-d7a7335e180c for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:15.567014 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Received event network-vif-deleted-cf5ef042-fb19-4415-ab20-d7a7335e180c {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:15.567320 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Neutron deleted interface cf5ef042-fb19-4415-ab20-d7a7335e180c; detaching it from the instance and deleting it from the info cache
May 26 05:21:15.567458 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:15.897129 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c111c430-52e7-4230-a277-1b251644c913] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:16.072022 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-642b7c60-9d48-4643-acc0-05ff76cbfe45 req-55d4022c-7a2e-45d2-a964-613c1054e572 service nova] [instance: c111c430-52e7-4230-a277-1b251644c913] Detach interface failed, port_id=cf5ef042-fb19-4415-ab20-d7a7335e180c, reason: Instance c111c430-52e7-4230-a277-1b251644c913 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:21:16.398669 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c111c430-52e7-4230-a277-1b251644c913] Took 1.39 seconds to deallocate network for instance.
May 26 05:21:16.941651 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:21:17.446332 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:17.446503 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:17.603708 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:17.603876 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:17.902470 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003161610002280213 future=<Future at 0x7d7aa4378ad0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:17.902946 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Emitting event <LifecycleEvent: 1779772862.9020581, ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:17.903083 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:17.903314 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] VM Stopped (Lifecycle Event)
May 26 05:21:17.904157 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.774389362999955 future=<Future at 0x7d7aa45cb290 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:17.904268 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=10.774279920000026 future=<Future at 0x7d7aa45cb290 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:17.917928 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:18.106088 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:18.405702 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-28461b07-0694-4342-bdeb-687d577ec433 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: ff5ff728-f33f-4cfb-a7eb-7cf0f75ddc4a] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:18.612100 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.165s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:18.654425 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Deleted allocations for instance c111c430-52e7-4230-a277-1b251644c913
May 26 05:21:19.201816 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:19.661317 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-389a39f1-7939-4327-a279-2bc53ac159d7 tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "c111c430-52e7-4230-a277-1b251644c913" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.827s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:20.759164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:20.759697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:20.759697 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:20.759794 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:20.759957 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:20.762388 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Terminating instance
May 26 05:21:21.266716 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:21:21.280821 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:21.282944 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:21.296899 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:21.298989 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:21.317873 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:21.403220 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:21.403388 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:21.403536 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:21.403655 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:21.404160 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] No waiting events found dispatching network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:21.404313 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3b1ea83d-05b1-4b90-8a1a-7c7b257759a9 req-f6b5592b-4d40-42da-a483-b82b96af5dd2 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:21.577028 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999699503000102 future=<Future at 0x7d7ac4414b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:21.578863 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Instance destroyed successfully.
May 26 05:21:21.578943 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid c39f8b1b-67dc-442b-b7b0-f6624ad60410 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:21:22.081291 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:20:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-507317515',display_name='tempest-TestVolumeBootPattern-server-507317515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-507317515',id=79,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:20:47Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-bypry08b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:20:47Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=c39f8b1b-67dc-442b-b7b0-f6624ad60410,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:21:22.081686 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "address": "fa:16:3e:1e:c0:8e", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd1e5aa-8d", "ovs_interfaceid": "ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:22.081937 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:22.082160 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:21:22.083067 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.083307 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd1e5aa-8d, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:22.084291 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.084977 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:22.085165 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.085779 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.085918 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b8e47eb-f7f8-4718-843a-67ac00dd053e) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:22.086316 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.086705 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:22.086847 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.088291 np0000001388 nova-compute[98319]: INFO os_vif [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:c0:8e,bridge_name='br-int',has_traffic_filtering=True,id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd1e5aa-8d')
May 26 05:21:22.089699 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:21:22.089983 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:22.090118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:22.090447 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:22.090732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:21:22.090851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:21:22.114296 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:22.114296 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:22.114296 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:22.114296 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:22.114296 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:22.114434 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:22.114434 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:22.114434 np0000001388 nova-compute[98319]: tcp: [221] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:22.114434 np0000001388 nova-compute[98319]: tcp: [222] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:22.114434 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:22.114546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '221'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:21:22.114625 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '221')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:22.115355 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '222')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:22.115954 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aec091300>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:21:22.116130 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:21:22.116604 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 33000000096ef513d {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:21:22.173638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:22.212727 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:22.250484 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:21:22.250650 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:21:22.251564 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:21:22.262327 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:21:22.262554 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:21:22.275861 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.307397 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 221, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260]
May 26 05:21:22.307397 np0000001388 nova-compute[98319]: Logout of [sid: 221, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260] successful.
May 26 05:21:22.307397 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.320023 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.333487 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.360803 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:22.361003 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:22.361175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:22.361487 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:22.361611 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:22.363235 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 222, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260]
May 26 05:21:22.363235 np0000001388 nova-compute[98319]: Logout of [sid: 222, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260] successful.
May 26 05:21:22.363235 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.363788 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Terminating instance
May 26 05:21:22.376101 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:22.376294 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:22.376438 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (286ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:22.376504 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:21:22.376709 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Deleting instance files /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410_del
May 26 05:21:22.377160 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Deletion of /opt/stack/data/nova/instances/c39f8b1b-67dc-442b-b7b0-f6624ad60410_del complete
May 26 05:21:22.867451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:21:22.881001 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.886909 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Took 1.62 seconds to destroy the instance on the hypervisor.
May 26 05:21:22.887700 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:21:22.887956 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:21:22.888009 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:21:22.888481 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:22.896233 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.898971 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.918312 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:22.970887 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:23.037096 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:23.037702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:23.037900 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:23.038086 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:23.038255 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:23.038367 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c4300a9e-7899-4611-b093-30b2e3884156 req-22a60e37-41ff-42dc-83bd-6268da5ee5f0 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:23.168862 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.193164 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.199424 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999631787999988 future=<Future at 0x7d7aa41638f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:23.204757 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Instance destroyed successfully.
May 26 05:21:23.205332 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lazy-loading 'resources' on Instance uuid 17158763-773e-42db-aaf8-0a57badcf9c4 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:21:23.208630 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.456543 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:23.457035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] Acquiring lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:23.457228 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:23.457302 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:23.457417 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] No waiting events found dispatching network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:23.457520 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-unplugged-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:23.457611 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Received event network-vif-deleted-ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:23.457714 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Neutron deleted interface ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5; detaching it from the instance and deleting it from the info cache
May 26 05:21:23.457832 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:23.522747 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.529470 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.549576 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.556730 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.660842 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.678646 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.707924 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:18:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPatternV346-server-1091776158',display_name='tempest-TestVolumeBootPatternV346-server-1091776158',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpatternv346-server-1091776158',id=71,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAG8lb9SI5ePlJMP32xJT5ChfG+R7aTxC1y9/hg/2ujiM+Dwf9qegGeLJ3hi9WbN+wCYvh8m7Ff+XxQ4yzRc2h93zGzUXrEULESYI2SiPcw02SNb64+jXZ9RY8w+VmaHkw==',key_name='tempest-keypair-102563367',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:18:21Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6588fb6c3894fadbc7f9ded9103be11',ramdisk_id='',reservation_id='r-ui85ovj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPatternV346-1982355268',owner_user_name='tempest-TestVolumeBootPatternV346-1982355268-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:18:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5818c10abb5d4f01b76e07eabdde16c1',uuid=17158763-773e-42db-aaf8-0a57badcf9c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:21:23.708267 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converting VIF {"id": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "address": "fa:16:3e:c1:30:09", "network": {"id": "b950eac7-7357-4c9e-b4fc-1a78cf908e6d", "bridge": "br-int", "label": "tempest-TestVolumeBootPatternV346-1956253034-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "a6588fb6c3894fadbc7f9ded9103be11", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd82473f7-9a", "ovs_interfaceid": "d82473f7-9a25-41d3-8c57-8ecad78453dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:23.708943 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:23.709189 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:21:23.710183 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.710448 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd82473f7-9a, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:23.711515 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.712349 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:23.712975 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.713128 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=338977d7-fd76-4288-a729-550a00629c9c) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:23.713835 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:23.714403 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:23.715922 np0000001388 nova-compute[98319]: INFO os_vif [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:30:09,bridge_name='br-int',has_traffic_filtering=True,id=d82473f7-9a25-41d3-8c57-8ecad78453dd,network=Network(b950eac7-7357-4c9e-b4fc-1a78cf908e6d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd82473f7-9a')
May 26 05:21:23.717339 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:21:23.717779 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:23.717928 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:23.718309 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:23.718638 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '19045b9f-cbc7-403b-84c0-d700e4df2b6c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-1'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:21:23.719157 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:21:23.740497 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:23.740497 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:23.740497 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:23.740694 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsi session list stdout=tcp: [201] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:23.740694 np0000001388 nova-compute[98319]: tcp: [202] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c (non-flash)
May 26 05:21:23.740694 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:23.740777 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:21:23.740888 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '201')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:23.741637 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c', '202')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:21:23.742263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa44c1760>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:21:23.742431 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:21:23.742624 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Flush multipath device 330000000a3417375 {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:21:23.794774 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:23.834732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:21:23.868530 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:21:23.868707 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:21:23.869419 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:21:23.871054 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:23.882370 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:21:23.883376 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:21:23.893661 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.923856 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 201, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.40.100,3260]
May 26 05:21:23.923856 np0000001388 nova-compute[98319]: Logout of [sid: 201, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.40.100,3260] successful.
May 26 05:21:23.923856 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.933914 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.942525 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.961127 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-40298bdd-6610-4ea9-bc1b-5e07c2972aa0 req-451c9136-cc44-4958-8f4d-61149aa85e20 service nova] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Detach interface failed, port_id=ebd1e5aa-8d67-4044-a2d0-8c5b5eafddc5, reason: Instance c39f8b1b-67dc-442b-b7b0-f6624ad60410 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:21:23.968757 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 202, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.50.100,3260]
May 26 05:21:23.968757 np0000001388 nova-compute[98319]: Logout of [sid: 202, target: iqn.2023-03.storpool.com:os--volume-19045b9f-cbc7-403b-84c0-d700e4df2b6c, portal: 192.168.50.100,3260] successful.
May 26 05:21:23.968757 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.979150 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:23.979394 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:23.979501 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] <== disconnect_volume: return (261ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:23.979609 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:21:23.979842 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Deleting instance files /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4_del
May 26 05:21:23.980331 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Deletion of /opt/stack/data/nova/instances/17158763-773e-42db-aaf8-0a57badcf9c4_del complete
May 26 05:21:24.372959 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Took 1.48 seconds to deallocate network for instance.
May 26 05:21:24.485990 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Took 1.62 seconds to destroy the instance on the hypervisor.
May 26 05:21:24.486549 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:21:24.486863 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:21:24.486969 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:21:24.487185 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:24.544680 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:24.919905 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Took 0.55 seconds to detach 1 volumes for instance.
May 26 05:21:25.091760 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.092577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.092577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.092577 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:25.092577 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:25.092670 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:25.092738 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.092866 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.092990 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.093093 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:25.093187 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:25.093295 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received unexpected event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with vm_state active and task_state deleting.
May 26 05:21:25.093379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.093480 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.093602 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.093702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:25.093792 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:25.093890 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received unexpected event network-vif-plugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with vm_state active and task_state deleting.
May 26 05:21:25.093976 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.094087 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.094188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.094458 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:25.094549 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:25.094639 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:25.094719 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.094821 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Acquiring lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.094955 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.095096 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] Lock "17158763-773e-42db-aaf8-0a57badcf9c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:25.095245 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] No waiting events found dispatching network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:25.095380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-unplugged-d82473f7-9a25-41d3-8c57-8ecad78453dd for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:21:25.095519 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Received event network-vif-deleted-d82473f7-9a25-41d3-8c57-8ecad78453dd {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:25.095665 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Neutron deleted interface d82473f7-9a25-41d3-8c57-8ecad78453dd; detaching it from the instance and deleting it from the info cache
May 26 05:21:25.095852 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:25.373291 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:25.425793 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:25.426046 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:25.549485 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:25.549661 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:25.598797 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-564cf3cb-7693-43a3-8181-5356ecd60bf8 req-a941da56-075d-49c6-aa70-d44acc686798 service nova] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Detach interface failed, port_id=d82473f7-9a25-41d3-8c57-8ecad78453dd, reason: Instance 17158763-773e-42db-aaf8-0a57badcf9c4 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:21:25.875005 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Took 1.39 seconds to deallocate network for instance.
May 26 05:21:26.052254 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:26.417418 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:21:26.557565 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.132s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:26.601313 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance c39f8b1b-67dc-442b-b7b0-f6624ad60410
May 26 05:21:26.922227 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:26.922407 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:27.001719 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:27.001916 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:27.504236 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:27.608542 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-0ccd03df-573b-4a4d-bc24-58a86d11a7ee tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "c39f8b1b-67dc-442b-b7b0-f6624ad60410" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.849s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:28.009812 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.087s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:28.051418 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Deleted allocations for instance 17158763-773e-42db-aaf8-0a57badcf9c4
May 26 05:21:28.678909 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003320949999761069 future=<Future at 0x7d7aa45cb290 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:28.679287 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:28.679287 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.897616472000209 future=<Future at 0x7d7ac4414b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:28.679287 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=7.897551632000159 future=<Future at 0x7d7ac4414b30 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:28.679423 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779772873.6784885, c111c430-52e7-4230-a277-1b251644c913 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:28.679578 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] VM Stopped (Lifecycle Event)
May 26 05:21:28.714343 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:29.058296 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-6e06f72f-a037-4635-9bfc-ddce4931f2ed tempest-TestVolumeBootPatternV346-1982355268 tempest-TestVolumeBootPatternV346-1982355268-project-member] Lock "17158763-773e-42db-aaf8-0a57badcf9c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.697s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:29.181987 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7c8565c0-90f4-4cbd-964c-cfdbb36f0afe tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: c111c430-52e7-4230-a277-1b251644c913] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:29.417521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:29.417684 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:29.919369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:21:30.463614 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:30.463758 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:30.466597 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:21:30.466713 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Claim successful on node np0000001388
May 26 05:21:31.362609 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:31.560067 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:31.560402 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:32.062860 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:32.568699 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.105s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:32.569152 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:21:32.828372 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:33.073988 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:21:33.074279 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:21:33.074522 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:33.074862 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:33.142765 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:21:33.577526 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:21:33.610446 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Successfully created port: 3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:21:33.715111 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:34.031744 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Successfully updated port: 3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:21:34.073285 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:34.073692 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing instance network info cache due to event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:21:34.074006 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] Acquiring lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:21:34.074089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] Acquired lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:21:34.074193 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing network info cache for port 3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:21:34.079752 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:21:34.533345 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:21:34.575672 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:34.585934 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Booting with volume 4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa at /dev/vda
May 26 05:21:34.626112 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:34.634122 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:21:34.638224 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:21:34.657871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:21:34.701164 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:21:34.701442 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:21:34.709063 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:21:34.709851 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043'] 
May 26 05:21:34.709999 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:21:34.710102 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:21:34.710353 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:34.710603 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating existing volume attachment record: b032e011-46a8-4c28-9307-d41d14ba4750 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:21:34.784823 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:35.287119 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-f309342f-0b18-4087-ae1d-3997b28087bc req-08540c80-47e5-4309-9f11-562ba7ba3e66 service nova] Releasing lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:21:35.287606 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:21:35.287767 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:21:35.842449 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:21:35.978246 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:36.090988 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:36.577191 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.00046076999979050015 future=<Future at 0x7d7ac4414b30 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:36.577362 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:36.577453 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.6215441560002546 future=<Future at 0x7d7aa41638f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:36.577540 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=1.6214529470003072 future=<Future at 0x7d7aa41638f0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:36.578144 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Emitting event <LifecycleEvent: 1779772881.576627, c39f8b1b-67dc-442b-b7b0-f6624ad60410 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:36.578347 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] VM Stopped (Lifecycle Event)
May 26 05:21:36.592877 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:21:36.593261 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance network_info: |[{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:21:36.798297 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:21:36.799407 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:21:36.799649 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Creating image(s)
May 26 05:21:36.799936 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:21:36.800064 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:21:36.800312 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:36.800501 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:36.800613 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:36.801052 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Start _get_guest_xml network_info=[{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'b032e011-46a8-4c28-9307-d41d14ba4750', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3cf9cae5-21cd-42a6-aabd-dd123b8d682d', 'attached_at': '', 'detached_at': '', 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'serial': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:21:36.804363 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:21:36.805338 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-2133951472', uuid='3cf9cae5-21cd-42a6-aabd-dd123b8d682d'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772896.8050187) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:21:36.806378 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:21:36.807053 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:21:36.807693 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:21:36.807854 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:21:36.808643 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:21:36.808892 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:21:36.809033 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:21:36.809127 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:21:36.809333 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:21:36.809420 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:21:36.809511 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:21:36.809658 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:21:36.809756 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:21:36.809865 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:21:36.809979 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:21:36.810091 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:21:36.818724 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:21:36.819022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:21:36.819142 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:36.819454 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:36.819615 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:21:36.830614 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:36.831208 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:21:36.831634 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:36.831851 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:21:36.832261 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:21:36.832427 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:21:36.843015 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:21:36.843015 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:36.848467 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:21:36.848467 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:36.854832 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa] added
May 26 05:21:36.854832 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:21:36.854832 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:21:36.854832 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:21:36.854832 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:21:36.854832 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:21:36.854832 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:36.855050 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:21:36.855268 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0234(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:21:36.855445 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:21:36.859872 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa] added
May 26 05:21:36.859872 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:21:36.859872 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:21:36.859872 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:21:36.859872 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:21:36.859872 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:21:36.859872 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:36.860029 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:21:36.860182 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0277(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:21:36.860344 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:21:37.081147 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: c39f8b1b-67dc-442b-b7b0-f6624ad60410] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:37.855877 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:21:37.860879 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:21:37.868343 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:21:37.868343 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:21:37.874737 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:21:37.874737 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:37.880859 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:37.887384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:37.893765 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:21:37.893765 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:37.893921 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:21:37.893921 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:37.894060 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:21:37.894060 np0000001388 nova-compute[98319]: 
May 26 05:21:37.899341 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
May 26 05:21:37.899341 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:37.899440 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
May 26 05:21:37.899440 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:37.899550 np0000001388 nova-compute[98319]: WARNING os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
May 26 05:21:37.899550 np0000001388 nova-compute[98319]: 
May 26 05:21:38.121682 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:38.121963 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:38.200143 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0010873649998757173 future=<Future at 0x7d7aa41638f0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:38.200394 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:21:38.200780 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] Emitting event <LifecycleEvent: 1779772883.1989384, 17158763-773e-42db-aaf8-0a57badcf9c4 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:38.201001 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] VM Stopped (Lifecycle Event)
May 26 05:21:38.703787 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-840782ee-cc88-48f9-b6f1-ac60a2d41c73 tempest-SnapshotDataIntegrityTests-2135014341 tempest-SnapshotDataIntegrityTests-2135014341-project-member] [instance: 17158763-773e-42db-aaf8-0a57badcf9c4] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:38.716153 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:38.929952 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260]
May 26 05:21:38.929952 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260] successful.
May 26 05:21:38.929952 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:38.930784 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260]
May 26 05:21:38.930784 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260] successful.
May 26 05:21:38.930784 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:38.942153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:38.947194 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:21:38.954993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.954993 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.954993 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:38.955185 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.955185 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.955185 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:38.955375 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.124s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:38.955482 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:21:38.956132 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('7', '-', '-', 0) found on session 225 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:21:38.956270 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:21:38.960255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.960255 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.960255 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:21:38.960384 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.960384 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:21:38.960384 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:21:38.960618 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.128s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:38.960733 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:21:38.961271 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('8', '-', '-', 0) found on session 226 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:21:38.961408 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:21:38.970379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 225 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:21:38.970379 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:21:38.976022 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:21:39.617612 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:39.617938 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:39.618185 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:39.618332 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:21:39.618551 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:39.975668 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 226 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:21:39.976077 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:21:40.618634 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:40.619015 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:40.846977 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 33000000096ef513d for multipath device dm-0 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:21:40.847284 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:21:40.847406 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (4027ms) {'type': 'block', 'scsi_wwn': '33000000096ef513d', 'path': '/dev/dm-0', 'multipath_id': '33000000096ef513d'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:21:40.847513 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000096ef513d', 'path': '/dev/dm-0', 'multipath_id': '33000000096ef513d'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:21:41.352264 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2133951472',display_name='tempest-TestVolumeBootPattern-server-2133951472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2133951472',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-7n67i0k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:21:34Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=3cf9cae5-21cd-42a6-aabd-dd123b8d682d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:21:41.352830 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:41.353328 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:41.354105 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf9cae5-21cd-42a6-aabd-dd123b8d682d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:21:41.501002 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:41.501332 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:41.617574 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:41.856780 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] End _get_guest_xml xml=<domain type="qemu">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <uuid>3cf9cae5-21cd-42a6-aabd-dd123b8d682d</uuid>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <name>instance-00000050</name>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-2133951472</nova:name>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:21:36</nova:creationTime>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         <nova:port uuid="3de4eebe-84d3-4750-b980-45b3e229d6e1">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.8" ipVersion="4"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <system>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="serial">3cf9cae5-21cd-42a6-aabd-dd123b8d682d</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="uuid">3cf9cae5-21cd-42a6-aabd-dd123b8d682d</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </system>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <os>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </os>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <features>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </features>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   <devices>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/disk.config"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </disk>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <alias name="ua-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-0"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <serial>4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa</serial>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </disk>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:54:52:2c"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <target dev="tap3de4eebe-84"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </interface>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/console.log" append="off"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </serial>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <video>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </video>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </rng>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:   </devices>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]: </domain>
May 26 05:21:41.856780 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Preparing to wait for external event network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2133951472',display_name='tempest-TestVolumeBootPattern-server-2133951472',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2133951472',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-7n67i0k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:21:34Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=3cf9cae5-21cd-42a6-aabd-dd123b8d682d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:21:41.858756 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:21:41.859140 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.859206 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:41.859457 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:21:41.859834 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.859992 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3fd58f86-9827-5275-9960-40c86d48c567', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:41.860657 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.861266 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:41.861518 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.863127 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.863252 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3de4eebe-84, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:41.863503 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3de4eebe-84, col_values=(('qos', UUID('83d1e3a8-8a0c-490a-b9cb-54582421c42d')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:41.863645 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3de4eebe-84, col_values=(('external_ids', {'iface-id': '3de4eebe-84d3-4750-b980-45b3e229d6e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:52:2c', 'vm-uuid': '3cf9cae5-21cd-42a6-aabd-dd123b8d682d'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:21:41.864229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.865229 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:21:41.869413 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:41.869968 np0000001388 nova-compute[98319]: INFO os_vif [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84')
May 26 05:21:41.902296 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:42.122250 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:42.122425 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:42.122553 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:42.122690 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:21:43.136857 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Periodic task is updating the host stat, it is trying to get disk instance-00000050, but disk file was removed by concurrent operations such as resize.: FileNotFoundError: [Errno 2] No such file or directory: '/opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/disk.config'
May 26 05:21:43.138345 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:21:43.139179 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:21:43.189061 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:21:43.189517 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=14457MB free_disk=72.58186340332031GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:21:43.189680 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:43.189961 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:43.384519 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:21:43.384651 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:21:43.384753 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:54:52:2c, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:21:43.385301 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Using config drive
May 26 05:21:43.890703 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:43.994538 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Creating config drive at /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/disk.config
May 26 05:21:43.997635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplq7kkode {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:21:44.047521 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplq7kkode" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:21:44.240733 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 3cf9cae5-21cd-42a6-aabd-dd123b8d682d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:21:44.241072 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:21:44.241072 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=704MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:21:43 up 53 min,  2 users,  load average: 2.16, 3.54, 4.11\n', 'num_instances': '1', 'num_vm_building': '1', 'num_task_spawning': '1', 'num_os_type_None': '1', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '1', 'io_workload': '1'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:21:44.320672 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:21:44.321206 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:21:44.401613 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.419057 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.507186 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.510528 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.548780 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0883fc54-828b-410a-bafb-f466b2ce3f9f req-35180ddc-3bd4-4687-be69-bfcfe36760df service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:44.549436 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0883fc54-828b-410a-bafb-f466b2ce3f9f req-35180ddc-3bd4-4687-be69-bfcfe36760df service nova] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:44.549612 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0883fc54-828b-410a-bafb-f466b2ce3f9f req-35180ddc-3bd4-4687-be69-bfcfe36760df service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:44.549781 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0883fc54-828b-410a-bafb-f466b2ce3f9f req-35180ddc-3bd4-4687-be69-bfcfe36760df service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:44.549978 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0883fc54-828b-410a-bafb-f466b2ce3f9f req-35180ddc-3bd4-4687-be69-bfcfe36760df service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Processing event network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:21:44.740675 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.742045 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.744065 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.758837 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:44.824162 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:21:45.073911 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772905.073499, 3cf9cae5-21cd-42a6-aabd-dd123b8d682d => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:45.075559 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:21:45.075727 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] VM Started (Lifecycle Event)
May 26 05:21:45.077446 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:21:45.080518 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance spawned successfully.
May 26 05:21:45.080858 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:21:45.330317 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:21:45.330702 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.140s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:45.330702 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 5.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:45.578073 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:45.579724 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:21:45.592090 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:45.592304 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:45.592595 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:45.592854 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:45.593166 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:45.593443 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:21:46.081859 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:21:46.082099 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772906.081941, 3cf9cae5-21cd-42a6-aabd-dd123b8d682d => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:46.082208 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] VM Paused (Lifecycle Event)
May 26 05:21:46.100465 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Took 9.30 seconds to spawn the instance on the hypervisor.
May 26 05:21:46.100605 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:46.584369 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:46.586210 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772906.586, 3cf9cae5-21cd-42a6-aabd-dd123b8d682d => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:21:46.586440 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] VM Resumed (Lifecycle Event)
May 26 05:21:46.599320 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:46.599320 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:21:46.599512 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:21:46.599652 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:46.599795 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] No waiting events found dispatching network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:21:46.599953 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-0c1f0118-3d9b-4b2a-973e-30bb48e30224 req-6be624e3-4703-4810-840d-137b6000fdce service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received unexpected event network-vif-plugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 for instance with vm_state active and task_state None.
May 26 05:21:46.609128 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Took 16.19 seconds to build instance.
May 26 05:21:46.866691 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:47.088511 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:21:47.090316 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:21:47.110653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-7daae73b-c1fd-4bad-9d55-382b082f12ce tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.693s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:21:47.929928 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:48.648001 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:21:48.648155 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing instance network info cache due to event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:21:48.648334 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] Acquiring lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:21:48.648423 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] Acquired lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:21:48.648577 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing network info cache for port 3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:21:49.150924 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:49.418492 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:21:49.531625 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updated VIF entry in instance network info cache for port 3de4eebe-84d3-4750-b980-45b3e229d6e1. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:21:49.531874 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:21:50.033701 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4be87d6e-011b-488b-8be1-cb1644af1d94 req-623e1f3c-1a95-458a-98ae-66df69907d22 service nova] Releasing lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:21:50.330713 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:50.331146 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:21:50.331146 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.29 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:21:51.869483 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:52.931566 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:56.872636 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:21:57.934104 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:01.886460 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:02.943530 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:06.899222 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:07.952430 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:11.920224 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:12.954105 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:16.923384 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:17.955572 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:21.926570 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:22.957832 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:26.928685 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:27.958213 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:28.204722 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:28.204908 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:28.706582 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Starting instance... {{(pid=98319) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}}
May 26 05:22:29.255105 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:29.255495 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:29.257991 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98319) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}}
May 26 05:22:29.258115 np0000001388 nova-compute[98319]: INFO nova.compute.claims [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Claim successful on node np0000001388
May 26 05:22:30.382146 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:22:30.382461 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:22:30.884941 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:22:31.392331 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.137s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:31.392898 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Start building networks asynchronously for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}}
May 26 05:22:31.897451 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Allocating IP information in the background. {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}}
May 26 05:22:31.898120 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] allocate_for_instance() {{(pid=98319) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}}
May 26 05:22:31.898120 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:31.898226 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:31.930919 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:31.957124 np0000001388 nova-compute[98319]: DEBUG nova.policy [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '81c16bd9a9bd4220aed3bc337a8e800b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c30ab7dc7994525ab85e2c2588023b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98319) authorize /opt/stack/nova/nova/policy.py:192}}
May 26 05:22:32.220000 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:32.345785 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Successfully created port: 491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}}
May 26 05:22:32.400543 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
May 26 05:22:32.734378 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Successfully updated port: 491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _update_port /opt/stack/nova/nova/network/neutron.py:569}}
May 26 05:22:32.775350 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-changed-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:22:32.775843 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing instance network info cache due to event network-changed-491586a5-e37a-42d4-a16b-d65904717080. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:22:32.776027 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] Acquiring lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:22:32.776126 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] Acquired lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:22:32.776416 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing network info cache for port 491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:22:32.903534 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Start building block device mappings for instance. {{(pid=98319) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}}
May 26 05:22:33.236089 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:22:33.277999 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:33.331372 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:22:33.407706 np0000001388 nova-compute[98319]: INFO nova.virt.block_device [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Booting with volume 371e2817-5048-4993-b2ca-9668dd20c10d at /dev/vda
May 26 05:22:33.440775 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.125', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000001388', 'execute': None}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:22:33.449455 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:22:33.452591 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.scaleio [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98319) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}}
May 26 05:22:33.470533 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): nvme version {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:22:33.513284 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] 'nvme version' failed. Not Retrying. {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
May 26 05:22:33.514065 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.nvmeof [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] nvme not present on system {{(pid=98319) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}}
May 26 05:22:33.523263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98319) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}}
May 26 05:22:33.523888 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.lightos [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Current host hostNQN  and IP(s) are ['10.4.3.125', 'fe80::f816:3eff:fe4c:c63a', '192.168.40.6', 'fe80::f816:3eff:fe62:1f86', '192.168.50.6', 'fe80::f816:3eff:fe7c:9980', '192.168.10.6', 'fe80::f816:3eff:fef2:148d', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::90bf:c0ff:feb9:9043', 'fe80::fc16:3eff:fe54:522c', 'fe80::5ca0:c8ff:fef8:5735'] 
May 26 05:22:33.524005 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}}
May 26 05:22:33.524121 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.lightos [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] LIGHTOS: no hostnqn found. {{(pid=98319) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}}
May 26 05:22:33.524379 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== get_connector_properties: return (83ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.125', 'host': 'np0000001388', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:77493cb5aee', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': 'afb55d94-db41-4ee0-872f-670786e9b79f', 'nvme_native_multipath': False} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:22:33.524690 np0000001388 nova-compute[98319]: DEBUG nova.virt.block_device [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating existing volume attachment record: b125b06e-7f45-4ec8-b35e-61dff118d610 {{(pid=98319) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}}
May 26 05:22:33.951777 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-6695467d-31f7-4f62-9f60-0367d9d9bee2 req-351f5bfe-4e89-4c13-be23-15c6ed0ad542 service nova] Releasing lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:22:33.953255 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquired lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:22:33.953255 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Building network info cache for instance {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}}
May 26 05:22:34.512037 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance cache missing network info. {{(pid=98319) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}}
May 26 05:22:34.648066 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:34.763574 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:22:35.265518 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Releasing lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:22:35.265819 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance network_info: |[{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98319) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}}
May 26 05:22:35.612530 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Start spawning the instance on the hypervisor. {{(pid=98319) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}}
May 26 05:22:35.613980 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Creating instance directory {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5215}}
May 26 05:22:35.614295 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Creating image(s)
May 26 05:22:35.614632 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Did not create local disks {{(pid=98319) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5349}}
May 26 05:22:35.614781 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Ensure instance console log exists: /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/console.log {{(pid=98319) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5094}}
May 26 05:22:35.615047 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:35.615292 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:35.615434 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:35.615958 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Start _get_guest_xml network_info=[{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'boot_index': 0, 'mount_device': '/dev/vda', 'delete_on_termination': False, 'attachment_id': 'b125b06e-7f45-4ec8-b35e-61dff118d610', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '68bd00ab-64ea-4a87-837f-3ff9ef8feed5', 'attached_at': '', 'detached_at': '', 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'serial': '371e2817-5048-4993-b2ca-9668dd20c10d'}, 'volume_type': None}], 'swap': None}share_info=None {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8192}}
May 26 05:22:35.620544 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:22:35.621804 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-TestVolumeBootPattern-server-1779082141', uuid='68bd00ab-64ea-4a87-837f-3ff9ef8feed5'), owner=OwnerMeta(userid='81c16bd9a9bd4220aed3bc337a8e800b', username='tempest-TestVolumeBootPattern-877823063-project-member', projectid='8c30ab7dc7994525ab85e2c2588023b2', projectname='tempest-TestVolumeBootPattern-877823063'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1779772955.6214106) {{(pid=98319) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}}
May 26 05:22:35.623012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V1... {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1783}}
May 26 05:22:35.623389 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller missing on host. {{(pid=98319) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1793}}
May 26 05:22:35.624290 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching host: 'np0000001388' for CPU controller through CGroups V2... {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1802}}
May 26 05:22:35.624482 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.host [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU controller found on host. {{(pid=98319) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1809}}
May 26 05:22:35.625474 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98319) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5886}}
May 26 05:22:35.625802 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-05-26T04:56:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}}
May 26 05:22:35.625970 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}}
May 26 05:22:35.626136 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image limits 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}}
May 26 05:22:35.626259 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flavor pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}}
May 26 05:22:35.626373 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Image pref 0:0:0 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}}
May 26 05:22:35.626502 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98319) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}}
May 26 05:22:35.626706 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}}
May 26 05:22:35.626829 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}}
May 26 05:22:35.626965 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got 1 possible topologies {{(pid=98319) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}}
May 26 05:22:35.627093 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}}
May 26 05:22:35.627263 np0000001388 nova-compute[98319]: DEBUG nova.virt.hardware [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98319) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}}
May 26 05:22:35.640550 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Calling os-brick to attach iSCSI Volume {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
May 26 05:22:35.640851 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:22:35.640971 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:22:35.641318 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:22:35.641488 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}}
May 26 05:22:35.652761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:22:35.653503 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:22:35.654118 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:22:35.655076 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:22:35.655332 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:22:35.655561 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:22:35.665728 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:22:35.665728 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:35.669997 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
May 26 05:22:35.669997 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:35.677186 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d] added
May 26 05:22:35.677186 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:22:35.677186 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:22:35.677186 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:22:35.677186 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:22:35.677186 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:22:35.677186 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:35.677460 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:22:35.677503 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.023(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:22:35.677649 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:22:35.679647 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d] added
May 26 05:22:35.679647 np0000001388 nova-compute[98319]:  stderr=iscsiadm: Config file line 363 does not have value
May 26 05:22:35.679647 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:22:35.679647 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:22:35.679647 np0000001388 nova-compute[98319]: iscsiadm: Config file line 363 does not have value
May 26 05:22:35.679647 np0000001388 nova-compute[98319]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs'
May 26 05:22:35.679647 np0000001388 nova-compute[98319]:  {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:35.679809 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98319) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}}
May 26 05:22:35.679944 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0247(s), this was the 1st time calling it. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}}
May 26 05:22:35.680076 np0000001388 nova-compute[98319]: DEBUG os_brick.utils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98319) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}}
May 26 05:22:36.678054 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260
May 26 05:22:36.680547 np0000001388 nova-compute[98319]: INFO os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.40.100
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:22:36.689583 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:22:36.689583 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.name = iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.tpgt = -1
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.startup = manual
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.leading_login = No
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.iscsi_ifacename = default
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.net_ifacename = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.ipaddress = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.prefix_len = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.hwaddress = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.transport_name = tcp
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.initiatorname = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.vlan_id = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.vlan_priority = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.vlan_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.iface_num = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.mtu = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.port = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.bootproto = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.subnet_mask = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.gateway = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_alt_client_id = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_dns = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_learn_iqn = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_req_vendor_id_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_vendor_id = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.dhcp_slp_da = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.fragmentation = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.gratuitous_arp = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.incoming_forwarding = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tos_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tos = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.ttl = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.delayed_ack = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tcp_nagle = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tcp_wsf_state = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tcp_wsf = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tcp_timer_scale = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.tcp_timestamp = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.redirect = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.def_task_mgmt_timeout = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.header_digest = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.data_digest = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.immediate_data = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.initial_r2t = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.data_seq_inorder = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.data_pdu_inorder = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.erl = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.max_receive_data_len = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.first_burst_len = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.max_outstanding_r2t = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.max_burst_len = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.chap_auth = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.bidi_chap = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.strict_login_compliance = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.discovery_auth = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: iface.discovery_logout = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.discovery_address = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.discovery_port = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.discovery_type = fw
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.initial_cmdsn = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.initial_login_retry_max = 8
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.xmit_thread_priority = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.cmds_max = 128
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.queue_depth = 32
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.nr_sessions = 1
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.authmethod = None
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.username = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.password = ***
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.username_in = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.password_in = <empty>
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.auth.chap_algs = SHA256
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.timeo.replacement_timeout = 120
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.err_timeo.abort_timeout = 15
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.err_timeo.lu_reset_timeout = 30
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.err_timeo.tgt_reset_timeout = 30
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.err_timeo.host_reset_timeout = 60
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.FastAbort = Yes
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.InitialR2T = No
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.ImmediateData = Yes
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.FirstBurstLength = 262144
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.MaxBurstLength = 16776192
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Retain = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.DefaultTime2Wait = 2
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.MaxConnections = 1
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.MaxOutstandingR2T = 1
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.iscsi.ERL = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.scan = auto
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.session.reopen_max = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].address = 192.168.50.100
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].port = 3260
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].startup = manual
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].tcp.window_size = 524288
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].tcp.type_of_service = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].timeo.logout_timeout = 15
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].timeo.login_timeout = 15
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].timeo.auth_timeout = 45
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_interval = 5
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].timeo.noop_out_timeout = 5
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.HeaderDigest = None
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.DataDigest = None
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.IFMarker = No
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: node.conn[0].iscsi.OFMarker = No
May 26 05:22:36.694836 np0000001388 nova-compute[98319]: # END RECORD
May 26 05:22:36.694836 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.700724 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.706006 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.712985 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.712985 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.712985 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:22:36.713218 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.713218 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.713218 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:22:36.720263 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.720263 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.720263 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:22:36.720405 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.720405 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.720405 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:22:36.743471 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.40.100,3260]
May 26 05:22:36.743471 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.40.100,3260] successful.
May 26 05:22:36.743471 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.754689 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.764317 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.50.100,3260]
May 26 05:22:36.764317 np0000001388 nova-compute[98319]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.50.100,3260] successful.
May 26 05:22:36.764317 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.769281 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.769281 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.769281 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.769281 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.769281 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:22:36.769516 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.769516 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.769516 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.769516 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.769516 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:22:36.769711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.116s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:22:36.769847 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.40.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:22:36.770580 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('9', '-', '-', 0) found on session 227 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:22:36.770709 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:22:36.776632 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:22:36.785711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 227 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:22:36.785711 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:22:36.790418 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:22:36.790640 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.136s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:22:36.790732 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to 192.168.50.100:3260 {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}}
May 26 05:22:36.791399 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] HCTL ('10', '-', '-', 0) found on session 228 with lun 0 {{(pid=98319) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}}
May 26 05:22:36.791583 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98319) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}}
May 26 05:22:36.804911 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: None {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:22:36.933464 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:37.805768 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Searching for a device in session 228 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98319) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}}
May 26 05:22:37.806184 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98319) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}}
May 26 05:22:38.668993 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Found WWN 3300000007b396e0c for multipath device dm-3 {{(pid=98319) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}}
May 26 05:22:38.669267 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.028s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:22:38.669449 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== connect_volume: return (3028ms) {'type': 'block', 'scsi_wwn': '3300000007b396e0c', 'path': '/dev/dm-3', 'multipath_id': '3300000007b396e0c'} {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:22:38.669614 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007b396e0c', 'path': '/dev/dm-3', 'multipath_id': '3300000007b396e0c'} {{(pid=98319) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}}
May 26 05:22:39.174563 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779082141',display_name='tempest-TestVolumeBootPattern-server-1779082141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1779082141',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-5hz5gaxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:22:33Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=68bd00ab-64ea-4a87-837f-3ff9ef8feed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98319) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}}
May 26 05:22:39.175003 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:22:39.175151 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:22:39.175784 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'pci_devices' on Instance uuid 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:22:39.617685 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:39.617939 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:39.618231 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:39.678289 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] End _get_guest_xml xml=<domain type="qemu">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <uuid>68bd00ab-64ea-4a87-837f-3ff9ef8feed5</uuid>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <name>instance-00000051</name>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <memory>196608</memory>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <vcpu>1</vcpu>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <metadata>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:package version="33.1.0"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:name>tempest-TestVolumeBootPattern-server-1779082141</nova:name>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:creationTime>2026-05-26 05:22:35</nova:creationTime>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:flavor name="m1.nano" id="42">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:memory>192</nova:memory>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:disk>1</nova:disk>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:swap>0</nova:swap>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:ephemeral>0</nova:ephemeral>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:vcpus>1</nova:vcpus>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:extraSpecs>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:           <nova:extraSpec name="hw_rng:allowed">True</nova:extraSpec>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         </nova:extraSpecs>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       </nova:flavor>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:image uuid="">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:minDisk>1</nova:minDisk>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:minRam>0</nova:minRam>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:properties>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:           <nova:property name="hw_rng_model">virtio</nova:property>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         </nova:properties>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       </nova:image>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:owner>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:user uuid="81c16bd9a9bd4220aed3bc337a8e800b">tempest-TestVolumeBootPattern-877823063-project-member</nova:user>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:project uuid="8c30ab7dc7994525ab85e2c2588023b2">tempest-TestVolumeBootPattern-877823063</nova:project>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       </nova:owner>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:root type="volume" uuid=""/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <nova:ports>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         <nova:port uuid="491586a5-e37a-42d4-a16b-d65904717080">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:           <nova:ip type="fixed" address="10.1.0.7" ipVersion="4"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:         </nova:port>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       </nova:ports>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </nova:instance>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </metadata>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <sysinfo type="smbios">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <system>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="manufacturer">OpenStack Foundation</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="product">OpenStack Nova</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="version">33.1.0</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="serial">68bd00ab-64ea-4a87-837f-3ff9ef8feed5</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="uuid">68bd00ab-64ea-4a87-837f-3ff9ef8feed5</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <entry name="family">Virtual Machine</entry>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </system>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </sysinfo>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <os>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <type arch="x86_64" machine="pc">hvm</type>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <boot dev="hd"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <smbios mode="sysinfo"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </os>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <features>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <acpi/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <tcg>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <tb-cache unit="MiB">128</tb-cache>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </tcg>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <vmcoreinfo/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </features>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <iothreads>1</iothreads>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <clock offset="utc"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <cpu mode="custom" match="exact">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <model>Nehalem</model>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <topology sockets="1" cores="1" threads="1"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </cpu>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   <devices>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <disk type="file" device="cdrom">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <source file="/opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/disk.config"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <target dev="hda" bus="ide"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </disk>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <disk type="block" device="disk">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <driver name="qemu" type="raw" cache="none" discard="unmap" io="native"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <alias name="ua-371e2817-5048-4993-b2ca-9668dd20c10d"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <source dev="/dev/dm-3"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <target dev="vda" bus="virtio"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <serial>371e2817-5048-4993-b2ca-9668dd20c10d</serial>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </disk>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <interface type="ethernet">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <mac address="fa:16:3e:09:43:72"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <driver name="qemu"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <mtu size="1372"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <target dev="tap491586a5-e3"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </interface>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <serial type="pty">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <log file="/opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/console.log" append="off"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </serial>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <video>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <model type="virtio"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </video>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <rng model="virtio">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <backend model="random">/dev/urandom</backend>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </rng>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <controller type="usb" index="0" model="none"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     <memballoon model="virtio" autodeflate="on" freePageReporting="on">
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:       <stats period="10"/>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:     </memballoon>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:   </devices>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]: </domain>
May 26 05:22:39.678289 np0000001388 nova-compute[98319]:  {{(pid=98319) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8199}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Preparing to wait for external event network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-05-26T05:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779082141',display_name='tempest-TestVolumeBootPattern-server-1779082141',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1779082141',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-5hz5gaxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-05-26T05:22:33Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=68bd00ab-64ea-4a87-837f-3ff9ef8feed5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:22:39.680066 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:22:39.680345 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3') {{(pid=98319) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}}
May 26 05:22:39.680667 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:39.680943 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:22:39.681355 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
May 26 05:22:39.681951 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:39.682085 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8a8205f4-3cf2-5592-bbc2-8588dafe47c4', '_type': 'linux-noop'}}, row=False) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:22:39.684130 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:22:39.685618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:39.685746 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491586a5-e3, may_exist=True, interface_attrs={}) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:22:39.686045 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap491586a5-e3, col_values=(('qos', UUID('b100acdb-16d2-4bb2-8102-7371953809ed')),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:22:39.686208 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap491586a5-e3, col_values=(('external_ids', {'iface-id': '491586a5-e37a-42d4-a16b-d65904717080', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:43:72', 'vm-uuid': '68bd00ab-64ea-4a87-837f-3ff9ef8feed5'}),), if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:22:39.687081 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:39.688438 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:22:39.692156 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:39.693159 np0000001388 nova-compute[98319]: INFO os_vif [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3')
May 26 05:22:40.617962 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:40.618577 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:41.206619 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name hda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:22:41.206733 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No BDM found with device name vda, not building metadata. {{(pid=98319) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13207}}
May 26 05:22:41.206834 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] No VIF found with MAC fa:16:3e:09:43:72, not building metadata {{(pid=98319) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13183}}
May 26 05:22:41.207220 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Using config drive
May 26 05:22:41.617531 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:41.617797 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:41.617857 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:22:41.618083 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.88 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:41.712179 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:41.818445 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Creating config drive at /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/disk.config
May 26 05:22:41.821349 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt2_olmhl {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:22:41.875529 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpt2_olmhl" returned: 0 in 0.054s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:22:42.242723 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:42.257618 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:42.341836 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:42.393404 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1176c367-6df6-4c29-b835-80022e1da40a req-2d9d6f41-375e-4af7-94d8-6ad4a5574667 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:22:42.394848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1176c367-6df6-4c29-b835-80022e1da40a req-2d9d6f41-375e-4af7-94d8-6ad4a5574667 service nova] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:42.394848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1176c367-6df6-4c29-b835-80022e1da40a req-2d9d6f41-375e-4af7-94d8-6ad4a5574667 service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:42.394848 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-1176c367-6df6-4c29-b835-80022e1da40a req-2d9d6f41-375e-4af7-94d8-6ad4a5574667 service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:42.394848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-1176c367-6df6-4c29-b835-80022e1da40a req-2d9d6f41-375e-4af7-94d8-6ad4a5574667 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Processing event network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}}
May 26 05:22:42.400637 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:42.401622 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:42.501487 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:42.501876 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:42.617738 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:42.877252 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772962.8767724, 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 => Started> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:22:42.877704 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98319) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}}
May 26 05:22:42.877898 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] VM Started (Lifecycle Event)
May 26 05:22:42.880092 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Guest created on hypervisor {{(pid=98319) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4893}}
May 26 05:22:42.882057 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance spawned successfully.
May 26 05:22:42.882302 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}}
May 26 05:22:42.959419 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:43.123012 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:43.123175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:43.123405 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:43.123478 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:22:43.380623 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:22:43.382594 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:22:43.388855 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_cdrom_bus of ide {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.389023 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_disk_bus of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.389292 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_input_bus of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.389520 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_pointer_model of None {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.389766 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_video_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.390012 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Found default for hw_vif_model of virtio {{(pid=98319) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}}
May 26 05:22:43.888163 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] During sync_power_state the instance has a pending task (spawning). Skip.
May 26 05:22:43.888593 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772963.8882592, 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 => Paused> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:22:43.888593 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] VM Paused (Lifecycle Event)
May 26 05:22:43.895144 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Took 8.28 seconds to spawn the instance on the hypervisor.
May 26 05:22:43.895312 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:22:44.142587 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:22:44.143822 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98319) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12328}}
May 26 05:22:44.145056 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:22:44.145843 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:22:44.190035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.044s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:22:44.190404 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=14081MB free_disk=72.57815933227539GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:22:44.190601 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:44.190928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:44.390848 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:22:44.394037 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Emitting event <LifecycleEvent: 1779772964.3937132, 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 => Resumed> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:22:44.394182 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] VM Resumed (Lifecycle Event)
May 26 05:22:44.403244 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Took 15.19 seconds to build instance.
May 26 05:22:44.446820 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:22:44.447018 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:22:44.447188 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:22:44.447325 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:44.447447 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] No waiting events found dispatching network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:22:44.447577 np0000001388 nova-compute[98319]: WARNING nova.compute.manager [req-a559981e-ddc0-4bcd-ba2b-bbf006294cac req-ea1e16d4-5f4e-4a9a-a1ab-361ea6de419b service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received unexpected event network-vif-plugged-491586a5-e37a-42d4-a16b-d65904717080 for instance with vm_state active and task_state None.
May 26 05:22:44.689497 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:44.896593 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:22:44.898350 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98319) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}}
May 26 05:22:44.904624 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-12e13496-e32d-46b0-a210-d0f35cef4db6 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.700s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:45.245334 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 3cf9cae5-21cd-42a6-aabd-dd123b8d682d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:22:45.245334 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Instance 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192}}. {{(pid=98319) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}}
May 26 05:22:45.245334 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:22:45.245334 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=896MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:22:44 up 54 min,  2 users,  load average: 1.02, 2.98, 3.88\n', 'num_instances': '2', 'num_vm_active': '2', 'num_task_None': '2', 'num_os_type_None': '2', 'num_proj_8c30ab7dc7994525ab85e2c2588023b2': '2', 'io_workload': '0'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:22:45.377808 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:22:45.377808 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:22:45.879257 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:22:46.117303 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-changed-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:22:46.117591 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing instance network info cache due to event network-changed-491586a5-e37a-42d4-a16b-d65904717080. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:22:46.117750 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] Acquiring lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:22:46.117911 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] Acquired lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:22:46.118068 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing network info cache for port 491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:22:46.386935 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:22:46.386935 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.196s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:22:46.387501 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 6.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:46.620111 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:46.897929 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:22:47.019027 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updated VIF entry in instance network info cache for port 491586a5-e37a-42d4-a16b-d65904717080. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:22:47.019354 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:22:47.521379 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-418c3808-92e6-41a1-95b3-1184de460046 req-0eb4a5c8-01e5-4d5e-8145-62e564eaf35c service nova] Releasing lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:22:47.960447 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:49.701987 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:52.387604 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:22:52.388431 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 47.23 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:22:52.960961 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:54.713056 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:57.963542 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:22:59.724887 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:02.963059 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:04.727101 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:07.964665 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:09.740881 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:12.966525 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:14.742634 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:17.968228 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:19.745286 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:22.760281 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-changed-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:22.761078 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing instance network info cache due to event network-changed-491586a5-e37a-42d4-a16b-d65904717080. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:23:22.761078 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] Acquiring lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:23:22.761304 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] Acquired lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:23:22.761649 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Refreshing network info cache for port 491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:23:22.969352 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:23.256898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:23.256898 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:23.257109 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:23.257156 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:23.257322 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:23.259209 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Terminating instance
May 26 05:23:23.263402 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:23.544097 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:23.669772 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updated VIF entry in instance network info cache for port 491586a5-e37a-42d4-a16b-d65904717080. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:23:23.670018 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [{"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:23.762295 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:23:23.773946 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:23.775649 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:23.789047 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:23.898536 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:23.898871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:23.898871 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:23.899252 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:23.899252 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] No waiting events found dispatching network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:23:23.899252 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-8b6f4b21-e6e3-430b-af75-e5e6810609fc req-a90277bb-36b3-435b-a5b3-649e5e2e0afe service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:23:23.931654 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:23.936035 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:24.091556 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.99970713599987 future=<Future at 0x7d7aa45f63c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:24.092471 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998736092999934 future=<Future at 0x7d7aa45f63c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:24.092580 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.998609959000078 future=<Future at 0x7d7aa45f63c0 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:24.093336 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Instance destroyed successfully.
May 26 05:23:24.093876 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:23:24.171686 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-3c3ec793-f9b6-4b66-89ea-e50a1f2d2191 req-14a0befe-6841-4c27-85a7-2ebf629256b7 service nova] Releasing lock "refresh_cache-68bd00ab-64ea-4a87-837f-3ff9ef8feed5" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:23:24.596462 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:22:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1779082141',display_name='tempest-TestVolumeBootPattern-server-1779082141',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-1779082141',id=81,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:22:43Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-5hz5gaxl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:22:44Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=68bd00ab-64ea-4a87-837f-3ff9ef8feed5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:23:24.596694 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "491586a5-e37a-42d4-a16b-d65904717080", "address": "fa:16:3e:09:43:72", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap491586a5-e3", "ovs_interfaceid": "491586a5-e37a-42d4-a16b-d65904717080", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:23:24.597259 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:23:24.597495 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:23:24.598743 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:24.598930 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491586a5-e3, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:23:24.600178 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:24.600834 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:24.601566 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:24.601697 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b100acdb-16d2-4bb2-8102-7371953809ed) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:23:24.602096 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:24.602695 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:24.604301 np0000001388 nova-compute[98319]: INFO os_vif [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:43:72,bridge_name='br-int',has_traffic_filtering=True,id=491586a5-e37a-42d4-a16b-d65904717080,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491586a5-e3')
May 26 05:23:24.605611 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:23:24.605887 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:23:24.606021 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:23:24.606373 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:23:24.606651 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '371e2817-5048-4993-b2ca-9668dd20c10d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:23:24.606789 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:23:24.629321 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:24.629321 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:24.629321 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:23:24.629321 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:23:24.629321 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:23:24.629519 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:24.629519 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:24.629519 np0000001388 nova-compute[98319]: tcp: [227] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:23:24.629519 np0000001388 nova-compute[98319]: tcp: [228] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d (non-flash)
May 26 05:23:24.629519 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:23:24.629641 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '226'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', '227'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', '228')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:23:24.629699 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', '227')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:23:24.630754 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d', '228')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:23:24.631693 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7aa458afc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'): ({'sde'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:23:24.631951 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sde, sdd {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:23:24.632255 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 3300000007b396e0c {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:23:24.688410 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:23:24.725592 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:23:24.760473 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:23:24.760664 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sde, sdd have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:23:24.761698 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sde', 'sdd'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:23:24.772761 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sde', 'sdd'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:23:24.773156 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:23:24.784000 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.808964 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 227, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.40.100,3260]
May 26 05:23:24.808964 np0000001388 nova-compute[98319]: Logout of [sid: 227, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.40.100,3260] successful.
May 26 05:23:24.808964 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.822478 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.832783 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.861048 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 228, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.50.100,3260]
May 26 05:23:24.861048 np0000001388 nova-compute[98319]: Logout of [sid: 228, target: iqn.2023-03.storpool.com:os--volume-371e2817-5048-4993-b2ca-9668dd20c10d, portal: 192.168.50.100,3260] successful.
May 26 05:23:24.861048 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.873708 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:24.873980 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:23:24.874092 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (268ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:23:24.874219 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:23:24.874490 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Deleting instance files /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5_del
May 26 05:23:24.875001 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Deletion of /opt/stack/data/nova/instances/68bd00ab-64ea-4a87-837f-3ff9ef8feed5_del complete
May 26 05:23:25.380328 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Took 1.62 seconds to destroy the instance on the hypervisor.
May 26 05:23:25.381003 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:23:25.381347 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:23:25.381464 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:23:25.381686 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:25.466611 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:25.670846 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5e1c1cc9-9770-43c2-b77f-5f6fb3bd0a3a req-8fe70e3d-8e71-464f-a2f7-dcaf2616416f service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-deleted-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:25.671344 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-5e1c1cc9-9770-43c2-b77f-5f6fb3bd0a3a req-8fe70e3d-8e71-464f-a2f7-dcaf2616416f service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Neutron deleted interface 491586a5-e37a-42d4-a16b-d65904717080; detaching it from the instance and deleting it from the info cache
May 26 05:23:25.671344 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5e1c1cc9-9770-43c2-b77f-5f6fb3bd0a3a req-8fe70e3d-8e71-464f-a2f7-dcaf2616416f service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:25.956484 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:25.956868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] Acquiring lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:25.956868 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:25.957035 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:25.957569 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] No waiting events found dispatching network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:23:25.957734 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-77b3bb8d-4277-49f3-9854-c448f2d1710a req-95ee5a5a-5f3f-4187-aa32-19cfe374c483 service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Received event network-vif-unplugged-491586a5-e37a-42d4-a16b-d65904717080 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:23:26.127561 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:26.174757 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5e1c1cc9-9770-43c2-b77f-5f6fb3bd0a3a req-8fe70e3d-8e71-464f-a2f7-dcaf2616416f service nova] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Detach interface failed, port_id=491586a5-e37a-42d4-a16b-d65904717080, reason: Instance 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:23:26.629311 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Took 1.25 seconds to deallocate network for instance.
May 26 05:23:27.170230 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:23:27.674746 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:27.674904 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:27.793082 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:23:27.793312 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:23:28.296129 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:23:28.801704 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.127s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:28.862415 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 68bd00ab-64ea-4a87-837f-3ff9ef8feed5
May 26 05:23:29.608282 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:29.608713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:29.608713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=98319) run /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:117}}
May 26 05:23:29.608713 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 05:23:29.617545 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:29.617683 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98319) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}}
May 26 05:23:29.869582 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-9ee0d880-c6c6-459b-bb65-3eac6a573d19 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "68bd00ab-64ea-4a87-837f-3ff9ef8feed5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.613s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:32.188768 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:32.189156 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing instance network info cache due to event network-changed-3de4eebe-84d3-4750-b980-45b3e229d6e1. {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11991}}
May 26 05:23:32.189364 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] Acquiring lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}}
May 26 05:23:32.189551 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] Acquired lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}}
May 26 05:23:32.189597 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Refreshing network info cache for port 3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}}
May 26 05:23:32.692151 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:32.705098 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:32.705327 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:32.705497 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:32.705635 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:32.705731 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:32.707771 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Terminating instance
May 26 05:23:33.210524 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Start destroying the instance on the hypervisor. {{(pid=98319) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}}
May 26 05:23:33.234150 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.236031 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.247706 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.253350 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.269337 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.377636 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:33.377689 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:33.377984 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:33.378068 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:33.378228 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] No waiting events found dispatching network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:23:33.378379 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-4ca8694f-0410-4604-983f-056f82aee4aa req-2e8f5def-4f8a-4ccb-88b5-19dbc0639eb2 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:23:33.414960 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:33.442568 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:33.519959 np0000001388 nova-compute[98319]: DEBUG nova.utils [None req-71f83b4f-01cd-4bb3-905e-97a97384b483 None None] Queued Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=14.999622888999966 future=<Future at 0x7d7ac43cbc50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:33.522156 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Instance destroyed successfully.
May 26 05:23:33.522537 np0000001388 nova-compute[98319]: DEBUG nova.objects.instance [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lazy-loading 'resources' on Instance uuid 3cf9cae5-21cd-42a6-aabd-dd123b8d682d {{(pid=98319) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}}
May 26 05:23:33.550492 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updated VIF entry in instance network info cache for port 3de4eebe-84d3-4750-b980-45b3e229d6e1. {{(pid=98319) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}}
May 26 05:23:33.550900 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [{"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:34.024562 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.vif [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-05-26T05:21:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2133951472',display_name='tempest-TestVolumeBootPattern-server-2133951472',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(11),hidden=False,host='np0000001388',hostname='tempest-testvolumebootpattern-server-2133951472',id=80,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClpduY8IsVRJBP1ekDoZt0kjANTbqpyGu7u8iihZt6p41ri/48h7rXPGhVefzuuzjUiKpXROpxTBASr4DXeqF9aygTgwBT9kq0dkpP7PXfMb4oEQ/bO6W4re2D2FTyVoA==',key_name='tempest-TestVolumeBootPattern-1161579290',keypairs=<?>,launch_index=0,launched_at=2026-05-26T05:21:46Z,launched_on='np0000001388',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=<?>,new_flavor=None,node='np0000001388',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c30ab7dc7994525ab85e2c2588023b2',ramdisk_id='',reservation_id='r-7n67i0k1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-877823063',owner_user_name='tempest-TestVolumeBootPattern-877823063-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2026-05-26T05:21:46Z,user_data=None,user_id='81c16bd9a9bd4220aed3bc337a8e800b',uuid=3cf9cae5-21cd-42a6-aabd-dd123b8d682d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}}
May 26 05:23:34.024835 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converting VIF {"id": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "address": "fa:16:3e:54:52:2c", "network": {"id": "ce6902b4-ec9e-4eec-924b-4318ece37e49", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1633328542-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "8c30ab7dc7994525ab85e2c2588023b2", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3de4eebe-84", "ovs_interfaceid": "3de4eebe-84d3-4750-b980-45b3e229d6e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
May 26 05:23:34.025316 np0000001388 nova-compute[98319]: DEBUG nova.network.os_vif_util [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84') {{(pid=98319) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}}
May 26 05:23:34.025562 np0000001388 nova-compute[98319]: DEBUG os_vif [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84') {{(pid=98319) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}}
May 26 05:23:34.026323 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:34.026496 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3de4eebe-84, bridge=br-int, if_exists=True) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:23:34.027376 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:34.028782 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:34.029149 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:34.029306 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83d1e3a8-8a0c-490a-b9cb-54582421c42d) {{(pid=98319) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
May 26 05:23:34.029681 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:34.030599 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}}
May 26 05:23:34.032150 np0000001388 nova-compute[98319]: INFO os_vif [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:52:2c,bridge_name='br-int',has_traffic_filtering=True,id=3de4eebe-84d3-4750-b980-45b3e229d6e1,network=Network(ce6902b4-ec9e-4eec-924b-4318ece37e49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3de4eebe-84')
May 26 05:23:34.033489 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] calling os-brick to detach iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}}
May 26 05:23:34.033748 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7d7ac4481be0>, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, None), 'kwargs': {'force': True}}" {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}}
May 26 05:23:34.033904 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}}
May 26 05:23:34.034212 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}}
May 26 05:23:34.034499 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-0'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}}
May 26 05:23:34.034653 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', 0)] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}}
May 26 05:23:34.053184 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-5bdb01a5-2190-4dcb-b819-7af2798696ff req-375ff3f2-a58e-4903-82a3-999e8f98bc4a service nova] Releasing lock "refresh_cache-3cf9cae5-21cd-42a6-aabd-dd123b8d682d" {{(pid=98319) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}}
May 26 05:23:34.055441 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:34.055441 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:34.055441 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}}
May 26 05:23:34.055605 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsi session list stdout=tcp: [225] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:34.055605 np0000001388 nova-compute[98319]: tcp: [226] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa (non-flash)
May 26 05:23:34.055605 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}}
May 26 05:23:34.055745 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '225'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '226')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}}
May 26 05:23:34.055878 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '225')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:23:34.056585 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa', '226')] {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}}
May 26 05:23:34.057164 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7d7ac46ca8e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'): ({'sdb'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'): ({'sdc'}, set())}) {{(pid=98319) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}}
May 26 05:23:34.057388 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Removing multipathed devices sdb, sdc {{(pid=98319) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}}
May 26 05:23:34.057600 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Flush multipath device 33000000096ef513d {{(pid=98319) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}}
May 26 05:23:34.111245 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:23:34.146546 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=98319) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}}
May 26 05:23:34.186432 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}}
May 26 05:23:34.186570 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] SCSI volumes sdb, sdc have been removed. {{(pid=98319) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}}
May 26 05:23:34.187136 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Checking to see if device paths {'sdb', 'sdc'} are still under multipathd monitoring {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}}
May 26 05:23:34.197791 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.linuxscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Device paths {'sdb', 'sdc'} have been removed from multipathd monitoring. {{(pid=98319) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}}
May 26 05:23:34.197942 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa')] {{(pid=98319) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}}
May 26 05:23:34.208844 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.238003 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 225, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260]
May 26 05:23:34.238003 np0000001388 nova-compute[98319]: Logout of [sid: 225, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.40.100,3260] successful.
May 26 05:23:34.238003 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.248666 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.258793 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.286153 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 226, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260]
May 26 05:23:34.286153 np0000001388 nova-compute[98319]: Logout of [sid: 226, target: iqn.2023-03.storpool.com:os--volume-4a6dbbb6-bdd0-44d3-aa42-fa94cc0f5bfa, portal: 192.168.50.100,3260] successful.
May 26 05:23:34.286153 np0000001388 nova-compute[98319]:  stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.295991 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98319) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}}
May 26 05:23:34.296242 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.base [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}}
May 26 05:23:34.296372 np0000001388 nova-compute[98319]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] <== disconnect_volume: return (262ms) None {{(pid=98319) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}}
May 26 05:23:34.296463 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Disconnected iSCSI Volume {{(pid=98319) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}}
May 26 05:23:34.296671 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Deleting instance files /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d_del
May 26 05:23:34.297112 np0000001388 nova-compute[98319]: INFO nova.virt.libvirt.driver [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Deletion of /opt/stack/data/nova/instances/3cf9cae5-21cd-42a6-aabd-dd123b8d682d_del complete
May 26 05:23:34.802858 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Took 1.59 seconds to destroy the instance on the hypervisor.
May 26 05:23:34.803419 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._common.loopingcall [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=98319) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}}
May 26 05:23:34.803786 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Deallocating network for instance {{(pid=98319) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}}
May 26 05:23:34.803945 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] deallocate_for_instance() {{(pid=98319) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}}
May 26 05:23:34.805529 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:34.889452 np0000001388 nova-compute[98319]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.
May 26 05:23:35.107300 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c2a93670-fa0a-46b9-b5a6-8ee575206fc4 req-9c8da3e8-54a2-430d-93e4-0535cb7e39dc service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-deleted-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:35.108242 np0000001388 nova-compute[98319]: INFO nova.compute.manager [req-c2a93670-fa0a-46b9-b5a6-8ee575206fc4 req-9c8da3e8-54a2-430d-93e4-0535cb7e39dc service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Neutron deleted interface 3de4eebe-84d3-4750-b980-45b3e229d6e1; detaching it from the instance and deleting it from the info cache
May 26 05:23:35.108242 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [req-c2a93670-fa0a-46b9-b5a6-8ee575206fc4 req-9c8da3e8-54a2-430d-93e4-0535cb7e39dc service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:35.425836 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) external_instance_event /opt/stack/nova/nova/compute/manager.py:11986}}
May 26 05:23:35.426362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] Acquiring lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:35.426362 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:35.426574 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:35.426626 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] No waiting events found dispatching network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 {{(pid=98319) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}}
May 26 05:23:35.426768 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-36099ef8-5c79-40d5-b243-ff965d34ae59 req-f50fad13-6090-4cb7-8631-4066ece09ad3 service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Received event network-vif-unplugged-3de4eebe-84d3-4750-b980-45b3e229d6e1 for instance with task_state deleting. {{(pid=98319) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}}
May 26 05:23:35.563485 np0000001388 nova-compute[98319]: DEBUG nova.network.neutron [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Updating instance_info_cache with network_info: [] {{(pid=98319) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}}
May 26 05:23:35.610600 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [req-c2a93670-fa0a-46b9-b5a6-8ee575206fc4 req-9c8da3e8-54a2-430d-93e4-0535cb7e39dc service nova] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Detach interface failed, port_id=3de4eebe-84d3-4750-b980-45b3e229d6e1, reason: Instance 3cf9cae5-21cd-42a6-aabd-dd123b8d682d could not be found. {{(pid=98319) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11820}}
May 26 05:23:36.065341 np0000001388 nova-compute[98319]: INFO nova.compute.manager [-] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Took 1.26 seconds to deallocate network for instance.
May 26 05:23:36.607992 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Took 0.54 seconds to detach 1 volumes for instance.
May 26 05:23:37.112641 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:37.112797 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:37.204845 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:23:37.205034 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:23:37.707436 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:23:38.213578 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.101s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:38.255344 np0000001388 nova-compute[98319]: INFO nova.scheduler.client.report [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Deleted allocations for instance 3cf9cae5-21cd-42a6-aabd-dd123b8d682d
May 26 05:23:39.031491 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:39.091587 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0003289820001555199 future=<Future at 0x7d7aa45f63c0 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:39.091997 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] Emitting event <LifecycleEvent: 1779773004.091133, 68bd00ab-64ea-4a87-837f-3ff9ef8feed5 => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:23:39.092145 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:39.092343 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] VM Stopped (Lifecycle Event)
May 26 05:23:39.092453 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Received Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.427087786999891 future=<Future at 0x7d7ac43cbc50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:39.093625 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=9.425909808000142 future=<Future at 0x7d7ac43cbc50 state=pending>) {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:39.262692 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-2bd1e81f-ccf5-4e69-ab1d-ea263301ae38 tempest-TestVolumeBootPattern-877823063 tempest-TestVolumeBootPattern-877823063-project-member] Lock "3cf9cae5-21cd-42a6-aabd-dd123b8d682d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.557s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:39.595260 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c0ac7e60-8622-49c4-bb6c-aa06fcd224a0 tempest-VolumeMultiattachTests-2100574999 tempest-VolumeMultiattachTests-2100574999-project-member] [instance: 68bd00ab-64ea-4a87-837f-3ff9ef8feed5] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:23:39.617825 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:39.618167 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:39.618442 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:41.617797 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:41.618282 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:41.618282 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:41.856247 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:41.904578 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:42.617623 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:43.121827 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:43.122143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:43.122143 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:43.122371 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:23:43.136402 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:23:43.137616 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:23:43.186756 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.049s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:23:43.187100 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=14480MB free_disk=72.57675170898438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:23:43.187313 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:23:43.187556 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:23:43.324892 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:44.032815 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:44.244898 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:23:44.245264 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:23:43 up 55 min,  2 users,  load average: 0.78, 2.57, 3.68\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:23:44.288923 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:23:44.289127 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:23:44.791601 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:23:45.297672 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:23:45.298088 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.110s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:23:45.298130 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:46.298363 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:46.298762 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:46.298762 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:23:46.298861 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 3.20 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:48.520174 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Task(fn=<bound method Host._event_emit of <nova.virt.libvirt.host.Host object at 0x7d7af4e8f6b0>>, remaining_delay=-0.0004084679999323271 future=<Future at 0x7d7ac43cbc50 state=running>) submitted to <futurist._futures.ThreadPoolExecutor object at 0x7d7af55e7140> {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:48.520622 np0000001388 nova-compute[98319]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98319) _log /opt/stack/nova/nova/utils.py:1500}}
May 26 05:23:48.520856 np0000001388 nova-compute[98319]: DEBUG nova.virt.driver [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] Emitting event <LifecycleEvent: 1779773013.5194712, 3cf9cae5-21cd-42a6-aabd-dd123b8d682d => Stopped> {{(pid=98319) emit_event /opt/stack/nova/nova/virt/driver.py:1874}}
May 26 05:23:48.521019 np0000001388 nova-compute[98319]: INFO nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] VM Stopped (Lifecycle Event)
May 26 05:23:49.023380 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-c11f37a0-7f9f-43cc-9599-59520a72b8bc tempest-TestEncryptedCinderVolumes-2040747730 tempest-TestEncryptedCinderVolumes-2040747730-project-member] [instance: 3cf9cae5-21cd-42a6-aabd-dd123b8d682d] Checking state {{(pid=98319) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}}
May 26 05:23:49.034098 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:49.500870 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:49.501166 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.12 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:50.617548 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:23:50.618055 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 49.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:23:54.036365 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:23:59.037988 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:04.040411 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:09.042276 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:14.044240 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:19.045671 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:24.047256 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:29.049085 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:34.050931 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:39.052638 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:39.617615 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:39.617977 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:40.618073 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:40.618502 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:41.617661 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:41.617880 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:42.617724 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager.update_available_resource {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:43.121653 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:24:43.121954 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:24:43.122180 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:24:43.122378 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Auditing locally available compute resources for np0000001388 (node: np0000001388) {{(pid=98319) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}}
May 26 05:24:43.133041 np0000001388 nova-compute[98319]: WARNING nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
May 26 05:24:43.133928 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
May 26 05:24:43.177429 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.processutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CMD "env LANG=C uptime" returned: 0 in 0.043s {{(pid=98319) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
May 26 05:24:43.177916 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Hypervisor/Node resource view: name=np0000001388 free_ram=14658MB free_disk=72.57625579833984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98319) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}}
May 26 05:24:43.178175 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}}
May 26 05:24:43.178480 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}}
May 26 05:24:44.055301 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:44.226904 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}}
May 26 05:24:44.227086 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Final resource view: name=np0000001388 phys_ram=24030MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 05:24:43 up 56 min,  1 user,  load average: 0.57, 2.20, 3.49\n'} {{(pid=98319) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}}
May 26 05:24:44.268252 np0000001388 nova-compute[98319]: DEBUG nova.virt.libvirt.driver [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98319) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9951}}
May 26 05:24:44.268460 np0000001388 nova-compute[98319]: DEBUG nova.compute.provider_tree [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed in ProviderTree for provider: 532664ff-66ca-4f17-bdd2-18f1300079ea {{(pid=98319) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
May 26 05:24:44.770901 np0000001388 nova-compute[98319]: DEBUG nova.scheduler.client.report [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Inventory has not changed for provider 532664ff-66ca-4f17-bdd2-18f1300079ea based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 24030, 'reserved': 512, 'min_unit': 1, 'max_unit': 24030, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98319) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}}
May 26 05:24:45.277255 np0000001388 nova-compute[98319]: DEBUG nova.compute.resource_tracker [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Compute_service record updated for np0000001388:np0000001388 {{(pid=98319) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}}
May 26 05:24:45.277729 np0000001388 nova-compute[98319]: DEBUG oslo_concurrency.lockutils [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.099s {{(pid=98319) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}}
May 26 05:24:45.277781 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:46.277801 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:46.278258 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:46.278258 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:46.278368 np0000001388 nova-compute[98319]: DEBUG nova.compute.manager [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98319) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}}
May 26 05:24:46.278619 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 4.34 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:49.057042 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:50.618174 np0000001388 nova-compute[98319]: DEBUG oslo_service.periodic_task [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98319) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}}
May 26 05:24:50.618588 np0000001388 nova-compute[98319]: DEBUG oslo.service.backend._threading.loopingcall [None req-a5262117-ea1a-470a-aa02-f6df61989e73 None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 51.00 seconds {{(pid=98319) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}}
May 26 05:24:54.057824 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:24:59.059008 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:25:04.061268 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:25:09.062884 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}
May 26 05:25:14.064474 np0000001388 nova-compute[98319]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 16 {{(pid=98319) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}}